Data Engineering Specialist

4 days ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000
Job Description

We are seeking a proactive Data Engineering Specialist to design, implement, and optimize data processing pipelines on the Databricks platform. You will be responsible for architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of our data infrastructure.

Roles & Responsibilities:

  • Design and develop data processing pipelines and analytics solutions using Databricks.
  • Architect scalable and efficient data models and storage solutions on the Databricks platform.
  • Collaborate with architects and other teams to migrate existing solutions to use Databricks.
  • Optimize the performance and reliability of Databricks clusters and jobs to meet SLAs.
  • Implement best practices for data governance, security, and compliance on the Databricks platform.
  • Mentor junior engineers and provide technical guidance.
Required Skills and Qualifications

To succeed in this role, you must have:

  • Proficiency in programming languages such as Python, Scala, or SQL.
  • Strong understanding of distributed computing principles and experience with big data technologies like Apache Spark.
  • Experience with cloud platforms like Azure, AWS, or GCP, and their associated data services.
  • Proven track record of delivering scalable and reliable data solutions in a fast-paced environment.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
Benefits

This role offers the opportunity to work on cutting-edge data engineering projects, collaborate with talented engineers, and grow your professional skills.

Others

A Bachelor's or Master's degree in Computer Science, Engineering, or a related field is required.

  • Data Engineer

    5 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Data Engineering SpecialistWe are seeking an experienced professional to join our team as a Data Engineering Specialist with 4+ years of experience in designing, building, and optimizing large-scale data processing pipelines using Azure Cloud technologies.Main Responsibilities:Design, develop, and maintain scalable data pipelines for batch data ingestion and...

  • Data Engineering Specialist

    1 week ago

    Pune, Maharashtra, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:We are seeking a highly skilled Data Engineering Specialist to join our team.The ideal candidate will have experience in designing, developing, and maintaining scalable data pipelines using cloud-based technologies such as Snowflake, Airflow, and PySpark.Skill Set:AWSSnowflakeKafkaAirflowGithubPySparkMain Responsibilities:To design, develop,...

  • Data Operations Engineer

    2 weeks ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Engineering SpecialistWe are seeking an accomplished and proactive Data Engineering Specialist to join our software development team. The ideal candidate will have expertise in designing, building, and maintaining scalable data systems that meet the needs of diverse applications.Main Responsibilities:Develop and maintain complex data...

  • Databricks Data Engineering Specialist

    1 week ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title:Databricks Data Engineering SpecialistJob Description:As a Databricks Data Engineering Specialist, you will be responsible for designing and building scalable data pipelines using Apache Spark and Databricks. You will work with relational databases and CDC, capturing change events using Debezium or native CDC tools and transforming them for...

  • Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data Engineering SpecialistAs a seasoned Data Engineer, you will be responsible for designing and implementing scalable data architectures to drive business growth. This role involves working with cross-functional teams to gather requirements, develop data pipelines, and ensure seamless integration with existing systems.Key Responsibilities:Design...

  • Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About the Role:The Data Engineering Specialist will be responsible for designing and implementing data models and views to enable data extraction and business insights. This role involves working with complex data systems, focusing on various components such as data flows, task chains, and data integration.Key responsibilities include:Building complex data...