AWS Glue ETL Developer Lead
4 days ago
Cognisol is looking for an experienced AWS Glue ETL Developer Lead to join our team. In this role, you will be responsible for building and maintaining complex ETL pipelines using AWS Glue.
Job Overview:
The successful candidate will have experience in designing, developing, and maintaining large-scale ETL processes using AWS Glue. You will work closely with cross-functional teams to understand data requirements and deliver solutions that meet the needs of our business.
Key Responsibilities:
- Design and develop complex ETL pipelines using AWS Glue.
- Collaborate with data architects, data engineers, and business stakeholders to understand data requirements.
- Develop and maintain scalable data processing solutions using AWS Glue.
- Implement data quality checks, error handling, and logging mechanisms within AWS Glue jobs.
Required Qualifications:
- 5-12 years of experience in data engineering and ETL development, with a strong focus on AWS Glue.
- Expertise in PySpark or Scala for data transformation tasks.
- Strong knowledge of AWS services: Glue, S3, Redshift, Athena, Lambda, Kinesis, and IAM.
-
AWS Glue Developer
4 days ago
Chennai, Tamil Nadu, India Cognisol Full timeJob DescriptionKey Responsibilities- Design, develop, and maintain ETL pipelines using AWS Glue to support data integration and transformation needs.- Build scalable and efficient data processing solutions leveraging AWS Glue's ETL capabilities.- Write complex PySpark or Scala scripts for data extraction, transformation, and loading processes.- Collaborate...
-
Lead Hadoop and AWS Data Architect
3 hours ago
Chennai, Tamil Nadu, India HCLTech Full timeKey ResponsibilitiesDesign and implement data architectures on AWS, including data pipelines, storage, and security.Collaborate with cross-functional teams to ensure seamless migration and integration.Optimize data architectures for scalability, performance, and cost-effectiveness.Requirements5+ years of experience in Hadoop development and...
-
AWS Data Engineer(Chennai, Indore
1 week ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeRole: AWS Data EngineerJOB LOCATION : Chennai, Indore , PuneEXPERIENCE REQUIREMENT : 4+Required Technical Skill:Strong Knowledge of Aws Glue/AWS REDSHIFT/SQL/ETL. Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL, DWH , Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA minimum of 3 +...
-
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeRole: AWS Data EngineerJOB LOCATION : Chennai, Bangalore, Mumbai, Indore ,PuneEXPERIENCE REQUIREMENT : 4+Required Technical Skill:Strong Knowledge ofAws Glue/AWS REDSHIFT/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL,DWH, Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA...
-
AWS Data Engineer
18 hours ago
Chennai, Tamil Nadu, India Risk Resources LLP Full timeRole : AWS Data EngineerRequired Technical Skill Set : ETL, SQL & AWSDesired Competencies (Technical/Behavioral Competency) :Must-Have :- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.Good-to-Have : PythonResponsibility of / Expectations from the Role :1. Good knowledge of...
-
Chennai, Tamil Nadu, India Chuwa America Corporation Full timeJob Title: ETL Automation Test Engineer - Python Job Overview: We are seeking a highly skilled Software Test Engineer with strong expertise in Python development, ETL testing, and CI/CD. Key Responsibilities: Automate manual ETL processes using Python scripting. Design, develop, and execute ETL test cases and test scripts to validate data pipelines. Perform...
-
ETL Automation Test Engineer – Python, ETL Testing
18 hours ago
Chennai, Tamil Nadu, India Chuwa America Corporation Full timeETL Automation Test Engineer - Python Fulltime Employment at Chennai or Pune, India Job Overview: We are looking for a highly skilled Software Test Engineer with strong Python development, ETL testing, and CI/CD experience . Our client has a large set of manual ETL scripts that need to be automated using Python , making Python scripting expertise essential ....
-
Chennai, Tamil Nadu, India Chuwa America Corporation Full timeETL Automation Test Engineer - PythonFulltime Employment at Chennai or Pune, IndiaJob Overview:We are looking for a highly skilled Software Test Engineer with strong Python development, ETL testing, and CI/CD experience. Our client has a large set of manual ETL scripts that need to be automated using Python, making Python scripting expertise essential. As...
-
AWS Big Data Engineer Specialist
3 days ago
Chennai, Tamil Nadu, India Coders Brain Technology Private Limited Full timeAbout UsCoders Brain Technology Private Limited is a forward-thinking technology company in the fast-evolving cybersecurity field. We are committed to innovation and continuous learning and development. As a key member of our data engineering team, you will play a vital role in shaping our data architecture and driving impactful data solutions.Job...
-
Cloud Data Engineering Lead
2 weeks ago
Chennai, Tamil Nadu, India HexaCorp Full timeAs a Cloud Data Engineering Lead, you will play a pivotal role in designing, developing, and implementing robust data solutions for our clients. You will lead a team of data engineers to deliver high-quality data pipelines and data lakes, ensuring seamless integration with various data sources and business intelligence platforms.Key Responsibilities : -...
-
Cloud Data Engineering Specialist
4 days ago
Chennai, Tamil Nadu, India Cognisol Full timeCognisol is seeking an experienced Cloud Data Engineering Specialist to join our team. In this role, you will be responsible for designing, developing, and maintaining scalable data processing solutions using AWS Glue.Key Responsibilities:Design and develop efficient ETL pipelines using AWS Glue to support data integration needs.Collaborate with data...
-
AWS Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeJob Title: AWS Data Engineer Experience: 4-8 years of experience in the field. Key Skills: Proficiency in Python programming and Pyspark Data Engineering expertise using AWS core services (Lambda, Glue, EMR, and RedShift) Familiarity with SQL, Airflow, Snowflake, Hive, and AWS S3 Responsibilities: Design, build, and test complex data pipelines (batch and...
-
AWS - Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Hexaware Technologies Full timeWe are looking for AWS Data Engineer for Chennai , Mumbai , Pune & Bangalore.Exp - 6-12 yearsPlease share your details at Saudaminic@hexaware.com.Name:Contact No:Email id :Current Company:Total Exp:Rel Exp in AWS:Notice period:Current CTC:Expected CTC:Current Location:Preferred Location:AWS Data EngineerPrimary Skillset:Proven experience as a Data Engineer...
-
Chennai, Tamil Nadu, India Photon Full timeJob description This individual will be part of the data engineering team working on the development of data pipelines, transformations of data, participation in proof of concept of new data patterns, optimization of existing data feeds and enhancements. Primary skills - RDBMS (Snowflake, Postgres), Cloud platforms and Services (AWS – IAM, EC2, S3,...
-
DBA Senior Consultant-Tech
2 weeks ago
Chennai, Tamil Nadu, India Mphasis Full timeAWS Data Engineer Lead Responsibilities: Designing and implementing highly performant data ingestion pipelines from multiple sources using AWS services such as AWS Glue, Glue Catalog, AWS Step Functions, AWS EMR, AWS Lambda. Building and maintaining data lakes and data warehouses in AWS to support data analytics and business intelligence....
-
AWS Architect
1 week ago
Chennai, Tamil Nadu, India Team1 Consulting Full timeAbout Company:Team1 Consulting is a leading System Integrator specializing in IT infrastructure, software, cyber security, cloud solutions, and generative AI domains. We deliver cutting-edge IT solutions tailored to drive innovation and accelerate business growth. Our expertise empowers organizations across industries to thrive in the digital era with...
-
Senior AWS Data Pipeline Engineer
7 days ago
Chennai, Tamil Nadu, India Millims Full timeExperience: 6+ years in data engineering with a focus on AWS cloud technologies. Technical Skills: o Expertise in AWS Glue, Lambda, EMR, Redshift, Kinesis, and Step Functions. o Proficiency in SQL, Python, and PySpark for data transformations. o Strong understanding of ETL/ELT best practices and data warehousing concepts. o Experience with Apache Airflow...
-
AWS Data Engineer
1 week ago
Chennai, Tamil Nadu, India Roshini R (Proprietor of BluePrism Solutions) Full timeJob DescriptionWe are looking for an experienced AWS Data Engineer with 6+ years of experience, including at least 2+ years of hands-on work with Databricks. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines using AWS services and Databricks. You will play a key role in processing large datasets, enabling...
-
Big Data Integration Expert
3 days ago
Chennai, Tamil Nadu, India Cognisol Full timeCognisol seeks a Big Data Integration Expert to join our team. In this role, you will be responsible for designing, developing, and maintaining efficient data processing solutions using AWS Glue.Job Description:The successful candidate will have experience in designing, developing, and maintaining large-scale data integration processes using AWS Glue. You...
-
Big Data Engineer
3 days ago
Chennai, Tamil Nadu, India Coders Brain Technology Private Limited Full timeJob DescriptionMandatory skillset:1. Apacha Kafka or AWS kinesys.2. Elastic Search or AWS open Search.3. Apacha Spark or aws Glue.4. PythonWe are looking for a skilled and experienced Big Data Engineer with expertise in modern cloud-based technologies, specifically AWS services like Kinesis, Glue, Lambda, and Kafka. The ideal candidate will have hands-on...