Job Description
Role : Data Engineer and GCP data Engineer
Location: Phoenix AZ (local candidate)
Duration : Long Term Contract
- Strong understanding of ETL and ELT patterns, data integration, data modeling, and distributed data processing.
- Hands-on development experience with Apache Spark using Scala and/or Python/PySpark.
- Experience working with RDBMS technologies and modern lakehouse/table formats, preferably Apache Iceberg.
- Experience with distributed SQL/query technologies such as Starburst and Trino.
- Experience designing real-time and streaming data solutions using technologies such as Apache Kafka and Spark Streaming.
- Understanding of integration patterns across NiFi, Kafka, Spark, RDBMS, and lakehouse platforms for batch and real-time data processing.
- Strong knowledge of software engineering practices including CI/CD, automated testing, source control, infrastructure/platform automation, observability, and production support.
- Experience with data governance, metadata management, data lineage, data quality, and secure data access in enterprise environments.