Large Scale Data Engineer

2 days ago

Mumbai, Maharashtra, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,30,00,000
Azure Databricks Engineer

Unlock the Power of Large-Scale Data Ingestion with this Exciting Opportunity

As an Azure Databricks Engineer, you will play a key role in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks. Your expertise will be pivotal in ensuring seamless data integration, minimizing latency, and maximizing throughput.

  • Key Responsibilities:
  • Design, develop, and optimize data ingestion pipelines to integrate multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

The ideal candidate will have a strong background in software engineering, with a focus on data processing and analytics. Excellent communication skills are essential for collaborating effectively with cross-functional teams.

Benefits:

  • Opportunity to work on large-scale data ingestion projects.
  • Collaborative environment with experienced professionals.
  • Chance to enhance your skills and expertise in data engineering.

Requirements:

  • Strong understanding of data ingestion processes.
  • Hands-on experience with data pipelines, automation, and infrastructure management.
  • Excellent problem-solving and analytical skills.
  • Ability to work collaboratively in a team environment.

  • Senior Data Engineer

    5 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalOverviewWe are seeking a skilled Data Engineering Professional to join our team. As a key member of our data engineering group, you will play a critical role in designing and implementing large-scale data processing systems.ResponsibilitiesDesign, develop, and deploy scalable data processing systems using SQL database...

  • Senior Electrical Project Manager for Large-Scale Data Center

    2 days ago

    Mumbai, Maharashtra, India beBeeElectricalProjectManager Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Electrical Project Manager for Large-Scale Data CenterDevelop and implement electrical systems design strategies for a major data center project. The ideal candidate will have strong expertise in electrical engineering, project management, and data center infrastructure.About the Role:This is an opportunity to lead a high-profile electrical design and...

  • Test Automation Specialist

    5 hours ago

    Mumbai, Maharashtra, India beBeeAutomation Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    The company is looking for a Test Automation Engineer to join their team in Mumbai.Job DescriptionWe are seeking an experienced professional to develop and execute performance and load testing for a large scale microservice based application.Key Responsibilities:Develop and execute performance and load testing for a large scale microservice based...

  • Large Scale Enterprise Account Builder

    3 days ago

    Mumbai, Maharashtra, India beBeeEnterprise Full time ₹ 40,00,000 - ₹ 50,00,000

    Strategic Enterprise Account DeveloperWe are seeking a highly motivated and experienced Strategic Enterprise Account Developer to drive revenue growth by creating and implementing account plans targeting large-scale enterprise deployments of the Palo Alto Networks Next Generation Security Platform.Key Responsibilities:Identify, acquire, lead, and develop...

  • Senior Construction Manager

    4 days ago

    Mumbai, Maharashtra, India beBeeCivilEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    About the RoleThis is a senior position that oversees construction site operations and involves executing big projects on large land areas.Key Responsibilities:Minimum 07-08 years of experience in construction site management.Executing various large-scale projects with acres of land area.Expertise in design and construction aspects of Civil, Structural and...

  • Data Engineering Leader

    4 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistThe RoleData Engineering is a crucial component of our organization's data-driven strategy. We are seeking an experienced Data Engineer to lead the development and implementation of scalable data pipelines using Azure Databricks, Apache Spark, and Python.Key Responsibilities:Data Pipeline Development: Design, build, and...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Bradford Consultants LLP Full time

    JD – Senior Data Engineer / Data Architect 12+ years of IT experience with expertise in data engineering, modeling, and architecture 5+ years designing enterprise data platforms (cloud/on-prem), including 3+ years with Snowflake Proficient in SQL, schema design, and data modeling tools (Snowflake certifications preferred) Strong knowledge of ELT/ETL...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Bradford Consultants LLP Full time

    JD – Senior Data Engineer / Data Architect12+ years of IT experience with expertise in data engineering, modeling, and architecture5+ years designing enterprise data platforms (cloud/on-prem), including 3+ years with SnowflakeProficient in SQL, schema design, and data modeling tools (Snowflake certifications preferred)Strong knowledge of ELT/ETL pipelines,...

  • Tableau Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India eNation Solutions Pvt. Ltd. Full time

    Job DescriptionRole DescriptionThis is a contract role for a Tableau Data Engineer, located on-site in Mumbai. The Tableau Data Engineer will be responsible for designing and implementing data solutions, including data modeling, ETL processes, and data warehousing. Daily tasks include managing data analytics, ensuring data quality and consistency, and...

  • Senior Data Engineering Leader

    1 day ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,80,000

    We are seeking a Senior Data Engineer to join our team.This role is ideal for a highly skilled professional with experience in designing, constructing, and optimizing large-scale data processing systems. In this position, you will work closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our...