Big Data Specialist

7 days ago

Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Databricks Data Engineer Opportunity

Key Responsibilities:

  • Develop and maintain scalable data pipelines and ETL processes on Databricks.
  • Lead the architecture and implementation of high-performance data solutions.
  • Collaborate with stakeholders to deliver actionable data insights.
  • Optimize data workflows for performance, cost-efficiency, and reliability.
  • Integrate data from multiple sources into cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership.
  • Troubleshoot and resolve issues in data pipelines.

Required Skills & Experience:

  • 7+ years of experience in data engineering.
  • Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark, Spark SQL, and Scala.
  • Hands-on experience with cloud platforms.
  • Proficiency in data modeling, ETL development, and data warehousing concepts.
  • Solid understanding of big data ecosystems.
  • Strong SQL development skills with a focus on performance tuning.
  • Experience in implementing CI/CD pipelines.

About This Role

This is a key position that plays a critical role in the success of our data-driven initiatives. As a Databricks Data Engineer, you will design, develop, and maintain scalable data pipelines and ETL processes on Databricks. You will lead the architecture and implementation of high-performance data solutions, collaborate with stakeholders to deliver actionable data insights, and optimize data workflows for performance, cost-efficiency, and reliability.

We're Looking for Someone Who:

  • Has 7+ years of experience in data engineering.
  • Is an expert in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Has strong experience with PySpark, Spark SQL, and Scala.
  • Has hands-on experience with cloud platforms.
  • Is proficient in data modeling, ETL development, and data warehousing concepts.
  • Has a solid understanding of big data ecosystems.
  • Has strong SQL development skills with a focus on performance tuning.
  • Has experience in implementing CI/CD pipelines.

We Offer:

  • A dynamic work environment that fosters innovation and collaboration.
  • A competitive salary and benefits package.
  • The opportunity to work with a talented team of data professionals.
  • Professional growth and development opportunities.

  • Big Data Integration Specialist

    4 days ago

    Thāne, Maharashtra, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data Integration SpecialistWe are seeking a seasoned professional to join our team in the field of big data integration. As a key member, you will be responsible for validating data transformations, ingestion, and processing logic in Databricks tables across various layers.Key Responsibilities:Design and execute test cases to validate Databricks...

  • Big Data Professional

    4 days ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are looking for a skilled Big Data professional to join our team as a Big Data Engineer"> Big Data Engineer ", we require a candidate with strong skills in data engineering and analytics. The ideal candidate will have hands-on experience with Big Data technologies, including data ingestion, processing, and storage.">Key Responsibilities:Data Ingestion:...

  • Big Data Engineering Specialist

    7 days ago

    Thāne, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 16,00,000

    Job DescriptionWe are seeking a skilled Big Data Engineer to join our team. As a key member of our Professional Services, you will play a vital role in designing, building, and maintaining high-performance data pipelines that process massive amounts of data.Key Responsibilities:Design and implement scalable batch processing systems using Python and big data...

  • Senior Big Data Specialist

    13 hours ago

    Thāne, Maharashtra, India beBeeData Full time US$ 90,000 - US$ 1,60,000

    Data Engineering RoleWe are seeking a skilled Data Engineer to join our team.About the Role:This is an exciting opportunity for a seasoned professional with experience in designing and executing large-scale distributed data systems.The ideal candidate will have expertise in big data technologies, including Apache Hadoop, relational databases (e.g., MS SQL...

  • Big Data Developer

    4 weeks ago

    Thāne, Maharashtra, India Tata Consultancy Services Full time

    Role :Data Engineering/Big Data Development Location: HyderabadExperience: 4 to 10 YearsMust Have skills :Bigdata Hadoop Platform -Cloudera

  • Big Data Expert Wanted

    5 days ago

    Thāne, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Professional OpportunityKey Responsibilities:Greetings from a top IT services company.PySparkHiveTo succeed in this role, you should have experience with Big Data platforms and data ingestion from disparate sources. You will work closely with cross-functional teams to drive business outcomes.We offer competitive compensation and benefits packages to...

  • Lead Big Data Specialist

    13 hours ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,76,40,000 - ₹ 2,21,80,000

    Senior Data EngineerWe are seeking a Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems using big data technologies.Job DescriptionStudy existing technology landscape and understand current data integration framework and do impact assessment...

  • Big Data Leader

    6 hours ago

    Thāne, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    ">Senior Data Architect">This role is responsible for leading data engineering teams globally and collaborating with cross-functional teams to drive business outcomes. ">Lead large-scale data engineering projects using distributed systems like Apache Spark, HDFS, and Kubernetes.Design and implement scalable data pipelines for big data processing using Scala,...

  • Principal Big Data Specialist

    12 hours ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a skilled and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.The ideal candidate will have strong knowledge of data engineering concepts, including data pipelines, distributed systems, and big data...

  • AWS Big Data Engineer

    6 hours ago

    Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Description:As a data engineer, you play a vital role in crafting and implementing robust data pipelines to process channel activity data from diverse sources. This encompasses digital channels, Hadoop environments, and Terradata.Key Responsibilities:Design and maintain scalable data architectures that integrate multiple sources of data for effective...