Senior Databricks Developer - United States - 26417 - Maximus

General information

Job Posting Title

Senior Databricks Developer

Date

Thursday, November 14, 2024

City

Remote

Country

United States

Working time

Full-time

Description & Requirements

We are seeking a Senior Databricks Developer to join our team supporting an Internal Revenue Service (IRS) client.

The Senior Databricks Developer will conduct hands on development as a member of an integrated agile project team.

The ideal candidate will have a proven track record as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organizations. We are seeking someone with technical skills in Databricks development, performance tuning, and optimization. The candidate will assist in the design and development of high performant data ingestion pipelines from multiple sources using Databricks. The candidate will be involved in ingesting data from the silver layer and applying transformation logic using python for Data Marts in gold layer. They will ensure the quality and consistency of data is always maintained across source, fact, and summary tables.

Position is remote within US.

*Position is contingent on contract funding.

Essential Duties and Responsibilities:
- Provide design and implementation expertise to a cross-functional software development team.

- Design and develop software applications from business requirements in collaboration with other team members.

- Support testing and remediate defects.

- May mentor entry and mid-level developers.

- Develop scalable and re-usable frameworks for ingestion and transformation of large data sets.

- Work with other members of the project team to support delivery of additional project components (API interfaces, Search).

- Work with Batch processes in Databricks.

- Work within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

- Convert existing Informatica ETL code to Databricks code whenever it is feasible/required.

- Create and maintain Databricks queries to support dashboarding and/or reporting activities.

- SQL query development and optimization as required to support various reporting needs.

- Performance monitoring and diagnosis of the ingest pipeline and suggest continual improvement.

Minimum Requirements

- Bachelor's degree in related field.

- 5-7 years of related experience required.
- Equivalent combination of education and experience considered in lieu of degree.

- At least two (2) years of experience with Databricks

- Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS

- Comprehensive understanding of data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching.

- Experience in building ETL / data warehouse transformation processes

- Hands on experience in performance tuning and optimizing code running in programming languages such as PySpark and Python

- Good understanding of SQL, T-SQL and/or PL/SQL

- Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment

- Experience working with structured and unstructured data

- Experience working in an Agile environment

- Experience of working with relational databases: (SQL Server, PostgreSQL)

Preferred experience:

- Knowledge of IRS business systems and data

- Experience with non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Design and implement data ingestion pipelines from multiple sources ensuring the quality and consistency of data is always maintained.

- Work with event based / streaming technologies to ingest and process data.

- Experience working in a command line environment and a general understanding of Red Hat Linux OS, or other Unix-like OS.

- Databricks certification

- Knowledge of FedRAMP, FISMA and other Federal IT security guidelines.

Additional requirements as per Contract/Client:

- Candidates must meet requirements to obtain and maintain an IRS Minimum Background Investigation (MBI) clearance (active IRS Moderate Risk MBI clearance is a plus).

- Candidates must be a US Citizen or a Legal Permanent Resident (Green Card status) for at least three (3) years, and Federal Tax compliant

EEO Statement

Active military service members, their spouses, and veteran candidates often embody the core competencies Maximus deems essential, and bring a resiliency and dependability that greatly enhances our workforce. We recognize your unique skills and experiences, and want to provide you with a career path that allows you to continue making a difference for our country. We’re proud of our connections to organizations dedicated to serving veterans and their families. If you are transitioning from military to civilian life, have prior service, are a retired veteran or a member of the National Guard or Reserves, or a spouse of an active military service member, we have challenging and rewarding career opportunities available for you. A committed and diverse workforce is our most important resource. Maximus is an Affirmative Action/Equal Opportunity Employer. Maximus provides equal employment opportunities to all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status or disabled status.

Pay Transparency

Maximus compensation is based on various factors including but not limited to job location, a candidate's education, training, experience, expected quality and quantity of work, required travel (if any), external market and internal value analysis including seniority and merit systems, as well as internal pay alignment. Annual salary is just one component of Maximus's total compensation package. Other rewards may include short- and long-term incentives as well as program-specific awards. Additionally, Maximus provides a variety of benefits to employees, including health insurance coverage, life and disability insurance, a retirement savings plan, paid holidays and paid time off. Compensation ranges may differ based on contract value but will be commensurate with job duties and relevant work experience. An applicant's salary history will not be used in determining compensation. Maximus will comply with regulatory minimum wage rates and exempt salary thresholds in all instances.