Job Description
Requirements: Sr. Data Engineer, Master's degree in Computer Science, Computer Information Systems with 2 years of exp. Design and develop data pipelines for ingesting, transforming, and delivering structured and unstructured data using AWS Glue, Lambda, S3, Redshift, PostgreSQL, and EKS. Manage ETL/ELT workflows to support data processing for analytics and reporting, leveraging tools such as Airflow, dbt, and Amazon Web Services. Collaborate with cross-functional teams to gather requirements, translate them into technical specifications, and deliver actionable data solutions. Optimize Snowflake and AWS-based data workflows by fine-tuning SQL queries, indexing strategies, and storage configurations to improve processing speed. Automate and streamline data tasks by implementing CI/CD pipelines for data workflows, ensuring reliability, accuracy, and timely delivery of business-critical datasets. Implement data governance, security, and compliance protocols using AWS Lake Formation, IAM policies, VPC configurations, and other cloud-native security services, aligning with regulatory standards.