Role: Data Scientist
Location: Indianapolis, IN (46204) - Hybrid
Type of Contract: W2 Contract
Duration: 12 Months
Required Experience: 04+ Years
Job Description:
Seeking a Data Scientist/Data Engineer with hands-on expertise in Azure Databricks, PySpark, Spark SQL, Delta Lake, and Azure Synapse Analytics to develop and optimize enterprise data pipelines, lakehouse solutions, and data warehouse workloads. The candidate will support data integration, governance, security, and analytics for sensitive agency data.
Required Skills:
• Strong hands-on experience with Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Experience with medallion lakehouse architecture, batch/streaming pipelines, and incremental ingestion.
• Strong Azure Synapse Analytics, SQL, dimensional modeling, and data warehouse optimization skills.
• Experience with Azure Data Factory, Databricks Workflows, and Unity Catalog.
• Knowledge of ADLS Gen2, Microsoft Entra ID, Key Vault, data governance, and security controls.
• Experience with Git, CI/CD, Azure DevOps/GitHub, monitoring, and troubleshooting.
• Strong communication and technical documentation skills.
Preferred:
• Databricks Certified Data Engineer Associate/Professional.
• Microsoft Azure Data Engineer certification (DP-203).
• Experience with Power BI connectivity and performance optimization.
• Experience protecting sensitive data under HIPAA and agency security policies.