![EDGESOFT](https://media.trabajo.org/img/noimg.jpg)
AWS Data Engineer
2 months ago
Job Description :
- AWS Data Engineer with min of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
-
AWS Data Engineer
2 months ago
Bengaluru, India Torry Harris Full timeAre you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...
-
Bengaluru, India AWS India - Karnataka - D11 Full timeAWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....
-
AWS Data Engineer
1 week ago
Bengaluru, India Synechron Full timeJob Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQLLocation: Pune/BangaloreExperience Required: 7+ yearsRole Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data...
-
AWS Data Engineer
1 week ago
Bengaluru, India Synechron Full timeJob Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQLLocation: Pune/BangaloreExperience Required: 7+ yearsRole Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data...
-
Data Engineer
1 week ago
Bengaluru, India Acumant Full timeCompany DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...
-
Data Engineer, Infra-Finance Business intelligence
2 months ago
Bengaluru, India AWS India - Karnataka Full timeDo you have a desire to make a major contribution to the future in the rapid growth environment of Cloud Computing? Are you passionate about data and code? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process millions of records? Amazon Web Services is looking for a Data Engineer...
-
Data Engineer
1 week ago
Bengaluru, India Acumant Full timeCompany Description Acumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...
-
Data Engineer
2 weeks ago
Bengaluru, India Acumant Full timeCompany DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...
-
Data Engineer
2 weeks ago
Bengaluru, India Acumant Full timeCompany DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...
-
Data Engineer
1 month ago
Bengaluru, India Cayian India Pvt Limited Full timeCayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find out more about us here. The role As a Data Engineer, you will be a part of...
-
Aws Cloud Architect
2 months ago
Bengaluru, India NTT DATA Full time**Req ID**: 248981 We are currently seeking a AWS Cloud Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Background As an Amazon Web Services (AWS) cloud architect, you will be responsible to architect and manage the cloud environment for a Digital Banking Asset. Duties include architecting and implementing cloud solutions,...
-
Data Engineer
2 months ago
Bengaluru, India Spectrum Consulting Full timePosition : Data Infrastructure EngineerCore work that needs accomplished :Architect, design and build Data access solution using various tool sets on Client's AWS and other platforms like DBT, Airflow, Atlan to enable clients data governance goalsThe solution will enable managing access to enterprise data at various layers of clients data solutions and...
-
AWS Data Engineer
1 week ago
Bengaluru, India Birlasoft Full timeAbout Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...
-
AWS Data Engineer
1 week ago
Bengaluru, India Birlasoft Full timeAbout Birlasoft: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla...
-
AWS Data Engineer
2 weeks ago
Bengaluru, India Birlasoft Full timeAbout Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...
-
AWS Data Engineer
2 weeks ago
Bengaluru, India Birlasoft Full timeAbout Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...
-
AWS Data Engineer
1 week ago
Bengaluru, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential.Deloitte is where you’ll find unrivaled...
-
AWS Data Engineer
1 week ago
Bengaluru, India Deloitte Full timeWhat impact will you make? Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential. Deloitte is where you’ll find...
-
AWS Data Engineer
1 month ago
Bengaluru, India VY Systems Pvt Ltd. Full timeSALARY : 15LPA - 20LPAJob Summary : As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. Leveraging your expertise in data engineering and software development, you will collaborate with cross-functional teams to build robust data solutions...
-
AWS Data Engineer
4 weeks ago
Bengaluru, India Lucidspire Full timeExciting career opportunities await! Ready for New Challenges? Lucidspire Hiring!"Role: AWS Data EngineerExperience:4-6+YrsLocation: Bangalore ( Hybrid)Notice Period: ImmediateIf interested, please share your resume swathi.b@lucidspire.com Our client is a distinguished USA-based Digital Transformation Company with a global footprint spanning over 100...