Data Engineer for Scalable Data Pipelines
2 weeks ago
Acrocede Technologies Private Limited is seeking a highly skilled and experienced Data Engineer to join its dynamic team.
The ideal candidate will have extensive experience working with Hadoop platforms, expertise in Spark, Python, SQL, and knowledge of cloud-based solutions using AWS services such as S3, Glue, and Lambda.
This role requires the ability to work independently and collaboratively in a fast-paced environment, ensuring strong communication and stakeholder management skills to deliver top-quality solutions.
Data Pipeline Development: Design, build, and maintain scalable, reliable data pipelines using technologies like Spark, Python, Oozie, and Kafka.
ETL Processes: Develop, monitor, and optimize ETL (Extract, Transform, Load) processes to ensure efficient data flow and processing.
Data Management: Work with both SQL and NoSQL databases, ensuring proper data storage, retrieval, and query performance.
Cloud Integration: Implement and maintain cloud-based solutions using AWS services such as S3, Glue, and Lambda.
Collaboration: Collaborate with cross-functional teams including Data Scientists, Analysts, and Business stakeholders to ensure the data infrastructure supports business needs.
Automation & Optimization: Identify opportunities for process improvements and automation in data handling and storage.
Documentation: Maintain clear and comprehensive documentation for the data architecture, pipelines, and workflows.
Stakeholder Communication: Work closely with stakeholders to gather requirements, provide updates, and ensure alignment with business objectives.
Key Skills & Qualifications:
Must-Have Technical Skills:
5-10 years of hands-on experience as a Data Engineer.
Expertise in Hadoop platforms, with strong experience in Spark, Python.
Deep understanding of ETL processes and data pipelines.
Strong experience working with both SQL and NoSQL databases.
Experience with AWS services like S3, Glue, Lambda for building and managing data infrastructure.
Good to Have:
Familiarity with dbt (Data Build Tool) for data transformation workflows.
Experience with Snowflake for cloud data warehousing.
Knowledge of AWS Redshift, Athena, EMR, and other related AWS services.
Soft Skills:
Ability to work independently and in teams.
Strong problem-solving skills and a detail-oriented approach.
Excellent communication skills, both written and verbal, with a proven ability to interact with stakeholders across multiple levels.
-
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Nexthire Full timeRole SummaryWe are seeking an experienced Data Engineer to design, develop, and maintain scalable and robust data pipelines that support various data processing and analytics needs.This role involves collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.About the...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Genpact Full timeAt Genpact, we empower businesses to create lasting value for their clients by leveraging our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.We are seeking a highly skilled Data Engineer - Scalable Data Pipelines Specialist to join our team.ResponsibilitiesAs a Data Engineer, you will work closely...
-
Data Engineer
1 month ago
Bengaluru, Karnataka, India Nexthire Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our team and contribute to the design and development of scalable data pipelines.Main Responsibilities:Data Pipeline Design: Design, develop, and maintain scalable and robust data pipelines to support various data processing and analytics needs.Collaboration: Collaborate with data scientists,...
-
Cloud Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...
-
Bengaluru, Karnataka, India WEN Full timeBig Data Developer Opportunity at WENWe are seeking a highly skilled Big Data Developer to join our dynamic team at WEN. The ideal candidate will have hands-on experience in developing and optimizing data processing pipelines and possess strong expertise in big data technologies.Job Description OverviewIn this role, you will be responsible for designing,...
-
Cloud Data Engineer for Big Data Processing
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...
-
Data Engineering Expert
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.
-
Senior Cloud Data Architect
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeNTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...
-
Data Engineer Cloud Migration Specialist
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...
-
Data Engineer for Scalable Data Infrastructure
2 weeks ago
Bengaluru, Karnataka, India Aditya Consulting Full timeJob OverviewWe are seeking a highly skilled and experienced Cloud Data Engineer to join Aditya Consulting's dynamic team. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services.About the RoleThe successful candidate will be responsible for designing, building, and maintaining scalable data...
-
Cloud Data Engineer for Big Data Solutions
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...
-
Data Engineer: Scalable Data Architecture
2 days ago
Bengaluru, Karnataka, India TMRW House of Brands Full timeJob Description:TMRW House of Brands is seeking a highly skilled Data Engineer-II to design, develop, and maintain robust data pipelines for business intelligence and machine learning.About the Role:The ideal candidate will have 3-5 years of experience in data engineering and infrastructure space on big data technologies such as Hive, Spark, Pyspark,...
-
Cloud Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeWe are seeking a skilled Cloud Data Engineer to join our team in Bangalore, India.About the JobThis role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS. You will work with multiple data sources, including structured and unstructured data, and use AWS services such as S3, Lambda, Glue, and Kinesis for data...
-
Data Engineer for Scalable Data Solutions
1 week ago
Bengaluru, Karnataka, India Hexaware Technologies Full timeExperience: 5+ years of expertise in designing and developing large-scale data pipelines is required.Job Type: Full-timeSalary Range:We offer a competitive salary, estimated to be around ₹22-35 lakhs per annum, depending on experience and qualifications.About the Role:As a Data Engineer at Hexaware Technologies, you will play a key role in developing...
-
Bengaluru, Karnataka, India Freo Full timeAbout Freo">">Freo is a cutting-edge neobank that is revolutionizing digital banking with an innovative approach tailored to the unique needs of modern consumers in India and SE Asia. With a range of financial products such as a digital savings account, flexible credit lines, credit cards, and EMI cards, buy now pay later (BNPL) schemes, all in one place,...
-
Data Pipeline Specialist
4 weeks ago
Bengaluru, Karnataka, India TekPillar Full timeAbout the Role:Are you a skilled data professional looking to drive business insights and decision making? We're seeking a talented Data Pipeline Specialist to join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment. You'll have the opportunity to design, implement, and optimize data pipelines that drive business...
-
Data Engineering Cloud Specialist
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...
-
Data Engineering Specialist
1 month ago
Bengaluru, Karnataka, India NTT DATA Services Full timeJob Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...
-
Senior Time Series Data Engineer
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...