Job Description
We are seeking an experienced Senior Python Data Processing Developer to design and develop scalable data-processing solutions, implement complex business rules, and support cloud-based data workflows.
Key Responsibilities
- Develop and maintain Python-based data-processing and transformation workflows.
- Translate business rules and technical requirements into tested, production-ready code.
- Implement data validation, edit checks, aggregations, calculations, and transformation logic.
- Develop and maintain cloud-based processing jobs using AWS services.
- Build and optimize complex SQL queries and PostgreSQL-based data operations.
- Work with large structured and semi-structured datasets using Spark, PySpark, Polars, or similar technologies.
- Implement data-quality checks and validate processing outputs for accuracy and completeness.
- Troubleshoot production data issues and optimize processing performance.
- Collaborate with business, data, and engineering teams to support ongoing enhancements and releases.
- Participate in code reviews, testing, documentation, and Agile development activities.
Required Skills
- 6+ years of hands-on Python development experience, with a strong focus on data processing and business-logic implementation.
- Strong SQL and PostgreSQL experience.
- Experience developing complex SQL using CTEs, joins, aggregations, update/merge operations, and data transformations.
- Hands-on experience with AWS services such as:
- AWS Glue
- AWS Lambda
- AWS Step Functions
- Amazon S3
- Strong experience with Spark, PySpark, Polars, or similar large-scale data-processing frameworks.
- Experience designing and maintaining ETL/data-processing pipelines.
- Strong experience with data validation, reconciliation, and data-quality checks.
- Ability to work with large datasets and optimize data-processing performance.
- Strong debugging and problem-solving skills.
Preferred Skills
- Experience working with statistical, survey, financial, or other complex business-rule-driven datasets.
- Experience with Pandas or other Python data-processing libraries.
- Experience with cloud-native and serverless application development.
- Familiarity with CI/CD pipelines, Git, automated testing, and Agile development practices.
- Experience supporting production data-processing systems.
Work Authorization / Eligibility
Due to the nature of the engagement and background investigation requirements, U.S. Citizens and Lawful Permanent Residents (Green Card holders) are required.