Data Engineering Position

6 days ago

Varanasi, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Data Engineering Expert

We are seeking a highly skilled Data Engineer to join our team as we work on a project focused on integrating and processing channel activity data from multiple sources.

The ideal candidate will possess strong knowledge of AWS, Python, and has work experience in handling data from various sources such as Hadoop, working on large-scale data engineering solutions for data, and knowledge of data processing architecture.

Main Responsibilities:

  1. Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such as Hadoop.
  2. Work on AWS cloud infrastructure (including services like PySpark, Glue, EMR, Lambda, Redshift, Athena, and other services) and orchestration tools like Airflow to ensure high availability, scalability, and performance.
  3. Leverage Python for building automated data engineering solutions and data transformations.
  4. Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  5. Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  6. Ensure data quality, governance, and integrity across all data systems.

Required Skills and Qualifications:

  • AWS: Strong hands-on experience with AWS technologies such as PySpark, Glue, EMR, Lambda, Redshift, Athena, EC2, and S3.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies like Hadoop.
  • Strong Analytical Skills: Ability to analyze and interpret data from different digital channels.
  • Collaboration: Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
  • Problem Solving: Strong problem-solving skills and ability to handle complex data-related challenges.
  • Communication: Excellent communication skills, both written and verbal, for documentation and collaboration.

  • Data Engineer Position

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeData Full time US$ 80,000 - US$ 1,40,000

    Job Title:Data Engineering SpecialistWe are seeking a skilled Data Engineer to join our dynamic team. As a key member of our data infrastructure team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms.In this role, you will collaborate with cross-functional teams to ensure seamless data flow from various...

  • Data Architect Position

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants. This is a remote position with a contract duration of 1 year, potentially extendable.In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and...

  • Senior Data Engineer Position

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer Role SummaryThe role requires a highly skilled Big Data Engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka.Key responsibilities include designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.Additionally, the ideal candidate will have hands-on experience in streaming...

  • AWS Data Architect Position

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior AWS Data Engineer PositionWe are seeking an experienced and skilled AWS Data Engineer to lead the design, development, and implementation of end-to-end data engineering solutions on the AWS platform.The ideal candidate should have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modelling, Python, SQL, PartiQL...

  • Senior Software Engineer Position

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Software EngineerWe are seeking a highly skilled and experienced Senior Software Engineer to join our team.This is a senior level position for an experienced software engineer who can take ownership of complex projects and lead cross-functional teams.About the Role:Develop strong expertise in Node.js and Express.js with a focus on...

  • Strategic Data Engineer

    5 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 16,00,000

    Job OpportunityWe are seeking an experienced Data Engineer to join our team. In this role, you will play a key part in designing and modeling data systems.About the Role:• Analyze business requirements and identify opportunities for data-driven insights that drive business outcomes.• Design and model data architectures using Power BI schema to support...

  • Leading GCP Data Engineer for Scalable Solutions

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionWe are seeking a skilled Data Engineer to design, develop, and maintain data pipelines and data warehouse solutions on Google Cloud Platform.

  • AI Research Engineer, Reinforcement Learning Position

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeReinforcementLearning Full time ₹ 15,00,000 - ₹ 25,00,000

    AI Research Engineer, RL - Job OverviewThe role of the AI Research Engineer in Reinforcement Learning (RL) is to design and implement state-of-the-art algorithms for solving complex tasks. This involves collaborating with cross-functional teams to integrate these algorithms into existing systems.This position requires a high level of expertise in full-stack...

  • Sensor & Machine Vision Engineer

    1 week ago

    Varanasi, Uttar Pradesh, India Pando Data Full time

    Sensor & Machine Vision EngineerAt Pando Data, we're on a mission to bring Industry 4.0 to life in factories that need it most. We design smart, affordable AI + sensor systems that actually work on the shop floor - from measuring steel bars flying out of a rolling mill, to spotting defects in plastic pipes, to preventing theft in dispatch yards.We're a...

  • Database Engineer Position

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeDatabase Full time ₹ 10,00,000 - ₹ 20,00,000

    **Job Description:**We are seeking an experienced Database Engineer to join our team. As a key member of our database group, you will be responsible for designing, developing, and maintaining databases that meet the needs of our organization.The ideal candidate will have a strong background in database management systems, including SQL Server and other...