AWS Data Engineer
2 days ago
Role : AWS Data Engineer
Required Technical Skill Set : ETL, SQL & AWS
Desired Competencies (Technical/Behavioral Competency) :
Must-Have :
- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.
Good-to-Have : Python
Responsibility of / Expectations from the Role :
1. Good knowledge of SQL and Data warehousing Concepts
2. Experienced in AWS cloud services such as AWS EC2, AWS S3, AWS Lambda, AWS Glue and AWS Redshift
3. Hand on knowledge of Using Python & Pyspark for Data transformations
4. Good knowledge in glue to write transformation logic/ call custom code written in SQL /Pysprak file with transformation logic
5. To handle complex data processing using air flow
6. Cloud watch, custom logging using python
7. To perform data quality analysis using glue/pyspark
Key Responsibilities :
- Design, build, and maintain scalable data pipelines using AWS Glue and Redshift.
- Implement ETL processes to transform and prepare data for analysis.
- Develop and optimize SQL queries for efficient data retrieval and manipulation.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
- Utilize Apache Airflow for workflow management and to schedule data jobs.
- Ensure data quality and integrity across all data pipelines.
- Monitor performance and troubleshoot issues in data workflows.
- Document data models, workflows, and architecture for knowledge sharing.
- Stay updated with industry trends and AWS services to enhance data architecture.
- Work on data security protocols and ensure compliance with regulations.
- Participate in code reviews and contribute to best practices in data engineering.
- Assist in capacity planning and scaling of the data infrastructure.
- Create dashboards and reports to visualize data trends and insights.
- Train and mentor junior team members on data engineering best practices.
- Support data governance initiatives and contribute to a data-driven culture.
-
SysDev Engineer II, AWS Bedrock
4 weeks ago
Chennai, Tamil Nadu, India Amazon Web Services (AWS) Full timeJob DescriptionDescriptionAWS Utility Computing (UC) provides product innovations from foundational services such as Amazons Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWSs services and features apart in the industry. As a member of the UC organization, youll...
-
AWS - Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India Hexaware Technologies Full timeWe are looking for AWS Data Engineer for Chennai , Mumbai , Pune & Bangalore.Exp - 6-12 yearsPlease share your details at Saudaminic@hexaware.com.Name:Contact No:Email id :Current Company:Total Exp:Rel Exp in AWS:Notice period:Current CTC:Expected CTC:Current Location:Preferred Location:AWS Data EngineerPrimary Skillset:Proven experience as a Data Engineer...
-
AWS - Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Kavi Software Technologies Private Limited Full timeData EngineerWe are seeking an experienced AWS Data Engineer with expertise in Databricks to design, build, and optimize large-scale data pipelines and data processing workflows on the AWS Cloud. The ideal candidate will have hands-on experience working with Databricks, big data technologies, and AWS-native services, ensuring efficient data ingestion,...
-
AWS - Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Kavi Software Technologies Private Limited Full timeJob Description Data EngineerWe are seeking an experienced AWS Data Engineer with expertise in Databricks to design, build, and optimize large-scale data pipelines and data processing workflows on the AWS Cloud. The ideal candidate will have hands-on experience working with Databricks, big data technologies, and AWS-native services, ensuring efficient data...
-
AWS Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India MNR Solutions Pvt Full timeRole : AWS Data EngineerExperience Required : 6 to 11 YearsLocation : Bangalore/ChennaiSkills Required : - Design, develop, and optimize scalable data pipelines on AWS.- Collaborate with cross-functional teams to collect, process, and analyze large datasets.- Implement and manage ETL processes to ensure data integrity and availability.- Monitor and improve...
-
AWS Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Roshini R (Proprietor of BluePrism Solutions) Full timeJob DescriptionWe are looking for an experienced AWS Data Engineer with 6+ years of experience, including at least 2+ years of hands-on work with Databricks. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines using AWS services and Databricks. You will play a key role in processing large datasets, enabling...
-
AWS Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India MNR Solutions Full timeCurrently looking for AWS Data Engineer hiring for a Singapore Based MNC on permanent payroll.Experience : 6+yearsNotice Period : Immediate/Feb serving maxMode : Hybrid ModeLocation : Bangalore/Chennai(No Relocation candidates)Qualification : B.Tech/B.E Or BCA/MCA ( No Civil or Mechanical)Job Description : - Design, develop, and optimize scalable data...
-
AWS Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeJob Title: AWS Data Engineer Experience: 4-8 years of experience in the field. Key Skills: Proficiency in Python programming and Pyspark Data Engineering expertise using AWS core services (Lambda, Glue, EMR, and RedShift) Familiarity with SQL, Airflow, Snowflake, Hive, and AWS S3 Responsibilities: Design, build, and test complex data pipelines (batch and...
-
Hadoop and AWS Data Engineer
3 days ago
Chennai, Tamil Nadu, India HCLTech Full timeJob DescriptionWe are seeking an experienced Hadoop and AWS Data Engineer to join our team at HCLTech. As a key member of our team, you will be responsible for designing, building, and deploying scalable data architectures on AWS.Key Responsibilities:Design and implement data pipelines, storage, and security on AWSLead the migration of Hadoop workloads from...
-
AWS Data Engineer(Chennai, Indore
2 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeRole: AWS Data EngineerJOB LOCATION : Chennai, Indore , PuneEXPERIENCE REQUIREMENT : 4+Required Technical Skill:Strong Knowledge of Aws Glue/AWS REDSHIFT/SQL/ETL. Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL, DWH , Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA minimum of 3 +...
-
AWS Big Data Engineer Specialist
4 days ago
Chennai, Tamil Nadu, India Coders Brain Technology Private Limited Full timeAbout UsCoders Brain Technology Private Limited is a forward-thinking technology company in the fast-evolving cybersecurity field. We are committed to innovation and continuous learning and development. As a key member of our data engineering team, you will play a vital role in shaping our data architecture and driving impactful data solutions.Job...
-
System Development Manager, AWS NGDE
1 week ago
Chennai, Tamil Nadu, India Amazon Web Services (AWS) Full timeJob DescriptionDescriptionAWS Utility Computing (UC) provides product innovations from foundational services such as Amazons Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWSs services and features apart in the industry. As a member of the UC organization, youll...
-
Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India NTT DATA Full timeJob Description Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data...
-
AWS Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India CBTS Full timeJob Description Skills : Technical: solid understanding of Data Management, AWS tech stack like Python, Glue, Athena, Redshift, Lambda, data security, data governance, and privacy best practices to your AWS data pipelines Non-Tech: Solid communication, data design skills
-
Senior AWS Data Pipeline Engineer
1 week ago
Chennai, Tamil Nadu, India Millims Full timeExperience: 6+ years in data engineering with a focus on AWS cloud technologies. Technical Skills: o Expertise in AWS Glue, Lambda, EMR, Redshift, Kinesis, and Step Functions. o Proficiency in SQL, Python, and PySpark for data transformations. o Strong understanding of ETL/ELT best practices and data warehousing concepts. o Experience with Apache Airflow...
-
Senior Hadoop and AWS Data Engineer
2 days ago
Chennai, Tamil Nadu, India HCLTech Full timeJob OverviewHCLTech is seeking highly skilled professionals to lead our efforts in Hadoop and AWS data engineering. We are looking for individuals with expertise in designing and implementing data architectures on AWS, including data pipelines, storage, and security.
-
AWS Cloud Data Architect
5 days ago
Chennai, Tamil Nadu, India Hub Work Full timeJob DescriptionWe're seeking a highly skilled AWS Data Engineer to join our team at Hub Work. As an AWS Data Engineer, you'll be responsible for designing, developing, and maintaining large-scale data processing systems on AWS. You'll work closely with our data architects and engineers to ensure that our data solutions meet the needs of our clients.Key...
-
Hadoop and AWS Data Engineer
7 days ago
Chennai, Tamil Nadu, India HCLTech Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at HCLTech. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems using Hadoop and AWS technologies.ResponsibilitiesDevelop and deliver high-quality code for data processing and analytics workloads on...
-
Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India NTT DATA Services Full timeReq ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data engineer you will...
-
AWS Cloud Engineer
1 week ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeDear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : AWS Cloud EngineerExp range : 4 yrs to 10 yrsRole : Permanent RoleJob location : PAN INDIAInterview mode : MS TeamsPls find the Job Description below.Must have :AWS certifications such as AWS Certified Big Data - Specialty or AWS Certified Solutions Architect.Understanding of...