Data Engineer

1 week ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Description:

Seeking an experienced Data Engineer to join our organization. The ideal candidate will have a strong background in digital channel activities, data engineering, and cloud technologies, particularly in AWS.

We are looking for a talented individual who can work on a project with a focus on integrating and processing channel activity data from multiple sources, including Terradata, and Hadoop environments.

This is an exciting opportunity to leverage your skills in designing, building, and maintaining robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such as Hadoop and Terradata.

We value collaboration and innovation, and the successful candidate will possess strong knowledge of AWS, Python, and has work experience in handling data from various sources such as Hadoop , and Terradata, working on large-scale data engineering solutions for data, and knowledge of data processing architecture.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.
  • Work on AWS cloud infrastructure (including services like PySpark , Glue , EMR , lambda, Redshift , Athena, and other services like Iceberg) and orchestration tools like Airflow to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  • Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.

Skills & Experience Required:

To succeed in this role, you will need:

  • AWS: Strong hands-on experience with AWS technologies such as PySpark , Glue , EMR , lambda, Redshift , Athena, EC2 and S3.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies like Hadoop and Terradata.
  • Strong Analytical Skills: Ability to analyze and interpret data from different digital channels.
  • Collaboration: Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
  • Problem Solving: Strong problem-solving skills and ability to handle complex data-related challenges.

Benefits:

This is a fantastic opportunity to work with a talented team and develop your skills in data engineering. We offer a competitive salary and benefits package, as well as opportunities for career growth and professional development.

Requirements:

  • A degree in Computer Science, Engineering, or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.
  • Experience in working on Snowflake would be good to have.
  • Knowledge of ingesting real-time data ( Apache Kafka ) would be advantageous.

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Senior Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Urgent Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Senior, Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Business Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Experience: 4 to 6 YearsLocation: Hybrid/Bangalore]Employment Type: Full-TimeRole & responsibilitiesMust-Have Skills:46 years of experience in data engineering roles.Proven experience in data migration and conversion projects (SAP or non-SAP).Strong knowledge of ETL concepts, tools, and frameworks.Proficiency in SQL, Python, or other data scripting...

  • Data Visualization Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Req ID: 340987NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Visualization Engineer - Power BI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: As...