Highly Skilled Data Engineer Wanted

1 day ago

Pune, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Job Description

As a seasoned data engineer, you will be responsible for designing and implementing scalable data pipelines that transform raw, unstructured data into actionable insights. This role requires a deep understanding of big data technologies, including Hadoop, Spark, and NoSQL databases.

You will work closely with cross-functional teams to develop processes that support data transformation, data structures, metadata, dependencies, and workload management. Your expertise in data pipeline and workflow management tools, such as Airflow, will be crucial in ensuring seamless data flow.

The ideal candidate will have a strong background in software development, with experience in languages like Python, Java, and Scala. Familiarity with AWS cloud services, including EC2, EMR, RDS, and Redshift, is also essential. In addition, you should have a solid understanding of Agile methodology, test-driven development, source control management, and automated testing.

Key responsibilities include:

  • Designing and implementing data pipelines that meet business requirements
  • Developing and maintaining scalable data pipelines using HQL and 'Big Data' technologies
  • Working with stakeholders to identify data-related technical issues and provide solutions
  • Collaborating with data and analytics experts to improve data systems functionality
  • Implementing processes to validate data, monitor data quality, and ensure accurate production data availability
Required Skills and Qualifications
  • 5+ years of relevant experience in data engineering
  • Strong background in software development, with experience in languages like Python, Java, and Scala
  • Familiarity with big data tools, including Hadoop, Spark, Kafka, and NoSQL databases
  • Experience with data pipeline and workflow management tools, such as Airflow
  • Knowledge of AWS cloud services, including EC2, EMR, RDS, and Redshift
  • Understanding of Agile methodology, test-driven development, source control management, and automated testing
Benefits

This role offers a unique opportunity to work with cutting-edge technology and collaborate with a talented team of engineers. As a data engineer, you will have the chance to design and implement scalable data pipelines, working closely with stakeholders to ensure seamless data flow. You will also have the opportunity to grow your knowledge base and contribute to the development of innovative solutions.

  • Highly Skilled Data Engineer Wanted

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Azure Data EngineerDescriptionThis is a highly skilled role that involves designing, building and maintaining large-scale data engineering systems on Azure.The ideal candidate will have extensive experience in developing big data applications using Scala-Spark on Azure Databricks.They will be responsible for delivering solid production-level code...

  • Highly Skilled Data Engineer Wanted

    6 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud-Native Data Engineering ExpertWe are seeking a skilled professional to join our data engineering team and contribute to the development of innovative cloud-native data intensive applications.Key qualifications include 8+ years of experience in software development, with a focus on backend and data engineering, as well as hands-on experience with...

  • Highly Skilled Assurance Engineer Wanted

    11 hours ago

    Pune, Maharashtra, India beBeeAssurance Full time ₹ 8,00,000 - ₹ 15,00,000

    Job SummaryWe are seeking a highly skilled Assurance Engineer to join our team. The ideal candidate will have extensive experience working with Netcool and possess strong technical expertise.

  • Highly Skilled Data Analyst Wanted

    3 days ago

    Pune, Maharashtra, India beBeeTableau Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking a highly skilled data analyst with expertise in Tableau to design and develop impactful dashboards and reporting solutions.

  • Highly Skilled Data Specialist

    11 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Key Positions:Senior Data EngineerWe are looking for a highly skilled Senior Data Engineer to oversee the development and implementation of large-scale ETL pipelines using PySpark, data processing workflows on Azure Data Factory with Databricks, and various data storage solutions.Core Responsibilities:Design, build, and maintain complex data processing...

  • Highly Skilled Data Architect Wanted

    2 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 40,00,000

    Job DescriptionAs a data engineer, you will be responsible for designing and implementing efficient data pipelines to meet the business requirements of our organization. This involves creating and maintaining optimal data pipeline architecture, building scalable data pipelines using SQL and AWS 'Big Data' technologies, and assembling large complex data sets...

  • Highly Skilled Redshift Expert Wanted

    2 days ago

    Pune, Maharashtra, India beBeeRedshiftEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Redshift Engineer OpportunityLocation: Remote (Within India)Contract Duration: 6 months (extendable)At a leading provider of top-tier talent, we specialize in delivering specialized professionals across enterprise platforms. We are looking for a highly skilled Senior Redshift Engineer to support our clients in architecting, optimizing, and scaling AWS...

  • Highly Skilled QA Engineer Wanted

    9 hours ago

    Pune, Maharashtra, India beBeeQuality Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Software Quality Assurance EngineerWe are seeking a skilled and experienced Software Quality Assurance Engineer to join our team.The successful candidate will be responsible for ensuring the quality and reliability of our software products.Key responsibilities include:Designing and executing test plansUnderstanding and evaluating solutions,...

  • Highly Skilled Cloud Data Professional

    11 hours ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining scalable ETL/ELT pipelines.Key Responsibilities:Data Ingestion: Ingest data from various sources (APIs, databases, files, etc.)Real-Time and Batch Processing: Implement both...

  • Highly Skilled Data Integration Developer Wanted

    2 days ago

    Pune, Maharashtra, India beBeeKotlin Full time ₹ 20,04,000 - ₹ 24,36,000

    Are you a highly skilled Kotlin developer with expertise in data integration looking for a new challenge?Job Description:We are seeking an experienced Kotlin developer to join our team and contribute to the design, development, and maintenance of applications. The successful candidate will be responsible for developing software solutions using Kotlin,...