Data Engineer

2 days ago

Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

About the Job

We are seeking a highly skilled data solutions specialist to join our team. If you're passionate about working with data and want to embark on a career-driven journey, this role is perfect for you.

As a data solutions specialist, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Spark. You will also work on building robust frameworks for generating PDF reports using Python and Spark.

You will leverage Azure Databricks and Datalake for data processing and storage, develop APIs using Python's Flask framework to support front-end applications, and collaborate with architects and business stakeholders to understand reporting requirements.

We offer a fulfilling experience working with global leading manufacturing clients, providing best-in-class product information management implementation and building rich product content across channels and digital touchpoints.

  • Develop scalable pipelines to efficiently process transform data using Spark
  • Design and develop a scalable and robust framework for generating PDF reports using Python Spark
  • Utilize Snowflake Spark SQL to perform aggregations on high volumes of data

Mandatory Skills: Python, SQL, Spark, Azure Data Factory, Azure Datalake, Azure Databricks, Azure Service Bus, and Azure Event Hubs

Qualifications: Proven experience as a data engineer with a strong understanding of data pipelines and ETL processes, proficiency in Python with experience in data manipulation libraries such as Pandas and Numpy, experience with SQL, Snowflake, and Spark for data querying and aggregations, familiarity with Azure cloud services, and excellent communication and collaboration skills

Benefits: Competitive salary, opportunities for growth and development, and a dynamic work environment

What We Offer: A chance to work on challenging projects, collaborate with experienced professionals, and develop your skills in a fast-paced industry

  • Data Engineer

    3 weeks ago

    Allahabad, Uttar Pradesh, India CryptoChakra Full time

    Company DescriptionCryptoChakra is a leading cryptocurrency analytics and education platform focused on making digital asset markets accessible to everyone. By merging advanced predictive analytics with comprehensive learning resources, we empower traders, investors, and enthusiasts to navigate the crypto landscape confidently. Our platform uses AI-driven...

  • Data Engineer

    7 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the development of our data engineering solutions. The ideal candidate will have a strong background in designing and implementing scalable, secure, and efficient data integration systems.

  • Data Engineer

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 22,50,000 - ₹ 26,25,000

    Job OverviewWe are seeking a skilled professional to design, develop, and maintain scalable data platforms.This is a key role in shaping the future of cybersecurity by leveraging best practices for data engineering, platform development, and DevOps.Your ResponsibilitiesYou will be responsible for designing and developing data pipelines to extract, transform,...

  • Data Engineering Strategist

    1 day ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering LeadWe're seeking a seasoned Data Engineering Lead to spearhead the design, development, and maintenance of large-scale data systems. This role demands strong technical expertise in modern data engineering, coupled with leadership skills to foster data-driven innovation.Develop robust data platforms, establishing engineering standards, and...

  • Lead Data Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Azure Data EngineerKey responsibilities of this position include designing, building and maintaining robust data pipelines using Azure cloud services.To be successful in this role, you will need a strong background in data engineering, with expertise in Microsoft Azure. This includes experience with Azure Synapse Analytics, Azure Databricks, and Azure Data...

  • Chief Data Engineer

    1 day ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 40,00,000

    Key Data Engineering RoleWe are seeking a seasoned data engineering leader to spearhead the development of high-performance data platforms in clinical oncology and healthcare.The ideal candidate will have a strong background in data architecture, ETL, cloud platforms, and big data technologies, along with exceptional leadership, communication, and...

  • Data Engineering Lead

    5 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert Data Engineering LeadershipAbout the OpportunityAs an expert data engineering leader, you will oversee a team of skilled engineers and collaborate with clients to identify their data needs.Key Responsibilities:Develop and implement effective architecture strategiesAddress complex data modeling challengesDesign and deliver high-quality featuresLead a...

  • Senior Data Engineer

    7 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Job OpportunityAptimized seeks a Data Engineering & Business Intelligence professional to support enterprise data initiatives. This role combines hands-on data engineering and ETL development with business intelligence and reporting delivery, ensuring timely and accurate insights for stakeholders.The ideal candidate will be technically proficient in SQL,...

  • Senior Data Engineer

    1 day ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Azure Databricks engineers play a pivotal role in designing and implementing data processing systems leveraging cutting-edge big data technologies like Apache Spark. Key responsibilities encompass architecting scalable data pipelines, developing sophisticated data models, and optimizing database performance for seamless query execution.Key...

  • Senior Data Engineer

    1 day ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeadWe are seeking a highly skilled professional to lead our data engineering team. As a Senior ETL Developer, you will be responsible for designing and implementing scalable data pipelines using Databricks.Main Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical...