Senior Data Engineer

1 week ago

Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Title: Data Engineering Lead

We are seeking a highly skilled professional to lead our data engineering team. As a Senior ETL Developer, you will be responsible for designing and implementing scalable data pipelines using Databricks.

Main Responsibilities:

  • Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
  • Design and develop efficient data pipelines and ETL processes using Databricks.
  • Optimize Spark jobs to ensure high availability and reliability of data processing.
  • Maintain and improve existing Databricks notebooks, workflows, and dashboards.
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks.
  • Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services.
  • Stay current with the latest Databricks and big data technologies and trends.
  • Lead by example and guide junior engineers in best practices and design principles.

Requirements:

  • 6+ years of experience in development and maintenance in a data engineering project.
  • Proven expertise in writing complex SQL queries and knowledge of SQL Analytical functions.
  • Proficient in building and optimizing data pipelines and workflows in Databricks.
  • Familiarity with programming languages such as Python, Scala.

Bonus Points:

  • Experience working with cloud storage solutions such as HDFS, S3, ADLS.

Preferred Qualifications:

  • Excellent communication skills.

About the Role:

  • This is an excellent opportunity to grow your career in a dynamic environment.

  • Senior data engineer

    1 week ago

    Allahabad, Uttar Pradesh, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...

  • Senior Data Pipeline Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Seeking a skilled and driven Senior ETL Developer to join our data engineering team. The successful candidate will design and implement scalable and efficient data pipelines using cutting-edge technologies.">Design and develop large-scale data pipelines using IBM DataStage, AWS Glue, and SnowflakeCollaborate with cross-functional teams to ensure seamless...

  • Senior Data Engineering Professional

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Role:A senior data engineering professional with 3-12 years of experience in designing and developing scalable data pipelines, data lakes, and data warehouses. The ideal candidate will have expertise in data patterns, Python, SQL, and Apache Spark (PySpark).

  • Senior Data Engineering Lead

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 3,00,00,000 - ₹ 4,00,00,000

    Job Title: Senior Data Engineering LeadAbout the RoleWe are seeking an experienced Technical Program Manager to lead large-scale data engineering and cloud platform initiatives.Key Responsibilities:Develop and execute strategic plans for data engineering and cloud programs.Manage complex data ecosystems, including data lakes, warehouses, and real-time...

  • Senior Cloud Data Engineer

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeCloudDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAbout the Role:We are seeking a seasoned Cloud Data Engineer to join our team. As an expert in cloud data engineering solutions, you will be responsible for designing, developing, and implementing scalable, distributed systems on AWS.Key Responsibilities:Architect and deliver highly scalable, distributed cloud-based enterprise data...

  • Senior Data Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Azure Databricks engineers play a pivotal role in designing and implementing data processing systems leveraging cutting-edge big data technologies like Apache Spark. Key responsibilities encompass architecting scalable data pipelines, developing sophisticated data models, and optimizing database performance for seamless query execution.Key...

  • Data Engineering Lead

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert Data Engineering LeadershipAbout the OpportunityAs an expert data engineering leader, you will oversee a team of skilled engineers and collaborate with clients to identify their data needs.Key Responsibilities:Develop and implement effective architecture strategiesAddress complex data modeling challengesDesign and deliver high-quality featuresLead a...

  • Data Pipeline Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeBackend Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Backend Data & Integration Engineer PositionWe are seeking an experienced and skilled Senior Backend Data & Integration Engineer to join our team. As a key member of our engineering team, you will play a crucial role in designing and implementing robust data pipelines.The ideal candidate will have 4-8 years of experience in backend/data engineering...

  • Highly Skilled Data Engineering Expert Wanted

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Senior Data EngineerWe are seeking a skilled and experienced Senior Data Engineer to join our team. As a key member of the engineering team, you will be responsible for designing, developing, and implementing data pipelines using various tools and technologies.Key Responsibilities:Design and develop scalable data architectures and...

  • Senior Technical Architect

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job DescriptionWe are looking for a skilled Senior Lead Engineer to join our Commercial Data team in Advertising. The successful candidate will be responsible for leading the design, development, and optimization of features to ensure high-quality, scalable solutions that deliver exceptional user experiences.The ideal candidate will have well-versed...