
AWS Data Engineer
3 days ago
Key Responsibilities:
- Design & Develop Data Pipelines: Build and optimize scalable, reliable, and automated ETL/ELT pipelines using AWS services (e.g., AWS Glue, AWS Lambda, Redshift, S3) and Databricks.
- Cloud Data Architecture: Design, implement, and support in maintaining data infrastructure in AWS, ensuring high availability, security, and scalability. Work with lake houses, data lakes, data warehouses, and distributed computing.
- DBT Core Implementation: Lead the implementation of DBT Core to automate data transformations, develop reusable models, and maintain efficient ELT processes.
- Data Modelling: Build efficient data models to support required analytics/reporting.
- Optimize Data Workflows: Monitor, troubleshoot, and optimize data pipelines for performance and cost-efficiency in cloud environments. Utilize Databricks for processing large-scale data sets and streamlining data workflows.
- Data Quality & Monitoring: Ensure high-quality data by implementing data validation and monitoring systems. Troubleshoot data issues and create solutions to ensure data reliability.
- Automation & CI/CD: Implement CI/CD practices for data pipeline deployment and maintain automation for monitoring and scaling data infrastructure in AWS and Databricks.
- Documentation & Best Practices: Maintain comprehensive documentation for data pipelines, architectures, and best practices in AWS, Databricks, and DBT Core. Ensure knowledge sharing across teams.
Skills & Qualifications: Required:
- Bachelors / masters degree in computer science, Engineering or a related field.
- 4+ years of experience as a Data Engineer or in a similar role.
- Extensive hands-on experience with AWS services (S3, Redshift, Glue, Lambda, Kinesis, etc.) for building scalable and reliable data solutions.
- Advanced expertise in Databricks, including the creation and optimization of data pipelines, notebooks, and integration with other AWS services.
- Strong experience with DBT Core for data transformation and modelling, including writing, testing, and maintaining DBT models.
- Proficiency in SQL and experience with designing and optimizing complex queries for large datasets.
- Strong programming skills in Python/PySpark, with the ability to develop custom data processing logic and automate tasks.
- Experience with Data Warehousing and knowledge of concepts related to OLAP and OLTP systems.
- Expertise in building and managing ETL/ELT pipelines, automating data workflows, and performing data validation.
- Familiarity with CI/CD concepts, version control (e.g., Git), and deployment automation.
- Having worked under Agile project environment
Preferred:
- Experience with Apache Spark and distributed data processing in Databricks.
- Familiarity with streaming data solutions (e.g., AWS Kinesis, Apache Kafka).
-
Aws Data Engineer
3 days ago
Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per yearWe are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...
-
AWS Data Engineer
3 days ago
Bengaluru, Hyderabad, Pune, India Globant Full time US$ 90,000 - US$ 1,20,000 per yearWe seek a Senior-Level AWS Data Engineer who shares our passion for innovation and change. This role is critical to helping our business partners evolve and adapt to consumers' personalized expectations in this new technological era.Looking at highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong...
-
AWS Data Engineer
2 weeks ago
Hyderabad, Telangana, India Coforge Full timeWe're Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred.Locations: Hyderabad Only.Experience Required: 5 to 7 YearsSend your CV to the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You'll work with...
-
AWS Data Engineer
1 week ago
Hyderabad, Telangana, India Coforge Full timeWe're Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...
-
AWS Data Engineer
1 week ago
Hyderabad, Telangana, India Coforge Full timeWe're Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS....
-
AWS Data Engineer
1 day ago
Hyderabad, Telangana, India Coforge Full timeWe're Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...
-
AWS Data Engineer
3 days ago
Hyderabad, Telangana, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe'reHiring:AWS Data EngineersatCoforge Ltd.Immediate Joiners Preferred.Job Locations:Hyderabad & Greater NoidaExperience Required:5 to 7 YearsSend your CV toAbout the Role:As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You'll work with diverse...
-
Aws Data Engineer
3 days ago
Pune, Maharashtra, India Velotio Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per yearAbout Velotio:Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data...
-
Aws Data Engineer
3 days ago
Bengaluru, Hyderabad, Pune, India Celebal Technologies Full time US$ 1,20,000 - US$ 2,00,000 per yearOverview:As a Data Engineer, you will work with multiple teams to deliver solutions on the AWS Cloud using core cloud data engineering tools such as Databricks on AWS, AWS Glue, Amazon Redshift, Athena, and other Big Data-related technologies. This role focuses on building the next generation of application-level data platforms and improving recent...
-
AWS Data Engineer
3 weeks ago
Hyderabad, Bengaluru, Pune, India Saransh Software Solutions Private Limited Full timeJob DescriptionWe're Growing Our Data Engineering TeamJoin us at our Pan-India Walk-In Drive this Saturday, 23rd August and be part of our mission to build world-class cloud-native data solutions.Experience: 7 to 14 years (only relevant profiles will be considered)Locations: Hyderabad | Bangalore | Pune | ChennaiTiming: 10:00 AM 2:00 PMWork Mode:...