Lead Data Engineer

21 hours ago

Amrāvati, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

Job Title: Senior Data Architect

The role of a senior data architect involves making strategic decisions about the design and implementation of data systems. This includes selecting and integrating big data tools and frameworks to provide requested capabilities.

This position requires a strong understanding of data warehousing and data modeling techniques, as well as proficiency in distributed computing principles, such as Hadoop v2, MapReduce, and HDFS.

The ideal candidate will have experience with building stream-processing systems, using solutions like Storm or Spark-Streaming, and good knowledge of big data querying tools, such as Pig, Hive, and Impala.

Key Responsibilities:

  • Selecting and integrating big data tools and frameworks
  • Developing and maintaining data pipelines implementing ETL process
  • Translating complex technical and functional requirements into detailed designs
  • Investigating and analyzing alternative solutions for data storing and processing
  • Serving as a mentor to junior staff by conducting technical training sessions and reviewing project outputs

Required Skills:

  • Strong understanding of data warehousing and data modeling techniques
  • Proficient understanding of distributed computing principles - Hadoop v2, MapReduce, HDFS
  • Experience with building stream-processing systems, using solutions like Storm or Spark-Streaming
  • Good knowledge of big data querying tools, such as Pig, Hive, and Impala
  • Experience with Spark, SQL, and Linux
  • Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT
  • Experience with various messaging systems, such as Kafka or RabbitMQ

Benefits:

This is an excellent opportunity to work with a talented team and contribute to the success of our organization. If you are a motivated and experienced professional looking to take your career to the next level, we encourage you to apply.

  • Data Engineering Lead

    3 days ago

    Amrāvati, Maharashtra, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerWe are seeking an experienced Data Engineering Lead to join our team and help build scalable, high-performance data solutions.About the Role:The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. They will design, develop, and maintain data pipelines and...

  • Senior Lead Data Engineer

    16 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking an experienced Senior Lead Engineer to join our Commercial Data team in Advertising. This role involves developing leading property and market data insights to power Real Commercial products.This senior engineer will lead the design, development, and optimization of features to ensure high-quality, scalable solutions that deliver...

  • Lead Data Engineer

    1 week ago

    Amrāvati, Maharashtra, India The Conqueror Challenges Full time

    About the RoleWe're looking for a relentlessly curious Data Engineer to join our team as a Marketing Platform Specialist. This role is for someone who will dedicate themselves to extracting every possible byte of data from marketing platforms - the kind of person who gets excited about discovering hidden API endpoints and undocumented features.. You'll...

  • Lead Data Scientist/Visualization Engineer

    7 days ago

    Amrāvati, Maharashtra, India beBeeDataVisualization Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are excited to announce a new opportunity for a Lead Data Scientist / Data Visualization Expert.Location: Remote | Work from AnywhereExperience Level: Lead / Senior (Production-Level Expertise Required)About the ProjectOur team is working on an exciting initiative to build a cutting-edge dataset of visualizations for LLM training. This involves creating...

  • Senior Data Engineering Project Lead

    21 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 18,12,500 - ₹ 25,15,000

    About the OpportunityWe are seeking a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics. You will manage cross-functional teams to execute data platform, pipeline, and analytics initiatives, ensuring alignment with business goals and timely delivery.This role involves planning, executing, and delivering...

  • Lead Data Engineer

    2 days ago

    Amrāvati, Maharashtra, India beBeeMachineLearning Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job OpportunityAbout UsWe transform enterprise sales with cutting-edge AI solutions for forecasting, deal guidance, and revenue optimization.Key ResponsibilitiesDesign & Develop LLM Solutions: Conceptualize, design, and implement robust and scalable applications leveraging Large Language Models.Advanced Prompt Engineering: Develop, test, and refine complex...

  • Data Engineer

    2 weeks ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Unlock Your Potential as a Data EngineerWe're seeking an experienced and innovative Data Engineer to join our team. As a key member of our data analytics platforms, you will be responsible for developing and deploying scalable data processing pipelines using Azure Data Factory, Azure Databricks, and other relevant technologies.Your primary focus will be on...

  • Lead Data Integration Specialist

    7 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,20,000

    Job Opportunity: Senior Data EngineerWe are seeking an experienced data engineer to lead the design and implementation of our enterprise-wide data integration solutions.

  • Data Engineering Specialist

    2 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering Role OverviewWe are seeking a highly skilled Data Engineer to join our organization. The successful candidate will lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).

  • Data Engineer

    3 weeks ago

    Amrāvati, Maharashtra, India Centrilogic Full time

    Data EngineerPurpose:Over 15 years, we have become a premier global provider of multi-cloud management, cloud-native application development solutions, and strategic end-to-end digital transformation services.Headquartered in Canada and with regional headquarters in the U.S. and the United Kingdom, Centrilogic delivers smart, streamlined solutions to clients...