Senior Data Engineer

24 hours ago

Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
About the Role

At our organization, we are seeking a skilled Senior Software Engineer/Technical Specialist to join our team. This role is ideal for an individual with expertise in data engineering, including experience with Azure Data Factory (ADF), Databricks, and Synapse Analytics.

As a Senior Software Engineer/Technical Specialist, you will be responsible for developing and optimizing ETL/ELT pipelines, designing and implementing scalable data architectures, and performing data ingestion, transformation, and orchestration across structured and unstructured datasets.

Additionally, you will write and optimize SQL queries for data extraction, transformation, and analysis, and implement CI/CD pipelines for data workflows using Azure DevOps.

Collaboration with stakeholders is essential to understand data requirements and ensure data availability. You must also ensure data governance, security, and compliance in Azure-based data solutions.

Key Responsibilities:

  • Develop and Optimize ETL/ELT Pipelines: Utilize Azure Data Factory (ADF), Databricks, and Synapse Analytics to design, implement, and maintain efficient ETL/ELT pipelines.
  • Design and Implement Scalable Data Architectures: Develop and implement data architecture designs that meet business needs and adhere to best practices.
  • Perform Data Ingestion, Transformation, and Orchestration: Work on data ingestion, transformation, and orchestration tasks to deliver high-quality data insights.
  • Write and Optimize SQL Queries: Create and optimize SQL queries to extract, transform, and analyze data efficiently.
  • Implement CI/CD Pipelines: Design, implement, and maintain continuous integration and continuous deployment pipelines using Azure DevOps.
Requirements

To succeed in this role, you will require:

  • Strong Experience in Azure Data Engineering: Expertise in data engineering with focus on Azure Data Factory, Synapse, Fabric, and Databricks.
  • SQL, T-SQL, and Python Expertise: Strong proficiency in SQL, T-SQL, and Python for data processing and transformation.
  • Hands-on Experience with PySpark: Practical experience working with PySpark for big data processing.
  • Azure Data Lake (ADLS) Gen2 Proficiency: Hands-on experience with ADLS Gen2 for data storage and processing.
  • CI/CD and DevOps Knowledge: Familiarity with CI/CD concepts and tools, including Azure DevOps, Git, and automated deployments.
About Us

We are a technology company dedicated to delivering innovative IT solutions to our clients. With over two decades of core IT experience, we have built a reputation for excellence and efficiency in our work. We strive to match client goals with our technical expertise and impeccable execution capabilities to resolve critical issues affecting end-users.

  • Data Scientist/ML Engineer

    6 days ago

    Vijayawada, Andhra Pradesh, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Senior Data Engineering Strategist

    24 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering Strategist A senior data engineering strategist is required to lead and manage a team of experienced data engineers. The ideal candidate should have a strong background in enterprise-level data engineering roles with expertise in OLAP design, data warehousing concepts, and Snowflake. Key Responsibilities: Leverage...

  • Senior Data Engineering Expert

    3 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Data EngineerWe are looking for a skilled data engineer to join our team.The ideal candidate will have 5+ years of experience in ETL development and data engineering.In this role, you will be responsible for developing and maintaining data pipelines using FiveTran, DBT Cloud, and custom frameworks.You will work closely with the QC team to...

  • Senior Data Engineering Specialist

    1 day ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    About us:We are an ecommerce focused end-to-end data analytics firm assisting enterprises & brands in data-driven decision making to maximize business value. Our suite of work spans extraction, transformation, visualization & analysis of data delivered via industry-leading products, solutions & services. Our flagship product is a cloud-based ETL tool. We...

  • Senior Cloud-Native Data Engineering Specialist

    2 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineer - Cloud Native ExpertAbout the Role:We are seeking a seasoned Senior Data Engineer to lead our cloud-native data engineering initiatives. The ideal candidate will have in-depth experience with Databricks and AWS, as well as expertise in designing and developing scalable data pipelines.Key Responsibilities:Design and develop...

  • Senior Data Developer

    1 day ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Senior Data DeveloperAbout the Role:We are seeking a skilled data developer to join our team. As a senior data developer, you will be responsible for developing and maintaining scalable data pipelines to support increasing data volume and complexity.Main Responsibilities:Design and implement efficient data pipelines using various tools and...

  • Big Data Engineering Expert

    3 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Senior Big Data EngineerAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have hands-on experience with AWS, Python, and PySpark.Key ResponsibilitiesDesign, develop, and deploy scalable big data architectures using AWS services such as Amazon EMR, Amazon Athena, and AWS Glue.Work...

  • Senior Data Engineer – Large Retail Application

    3 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a highly skilled Senior Data Engineer to join our team in implementing an application for a large retailer.The ideal candidate will have hands-on coding expertise in Python and Pyspark, with strong experience in Telemetry, Big Data, and backend engineering.Key Responsibilities:Design and implement data processing pipelines using Python and...

  • Leadership Role in Data Engineering

    10 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Senior Data Engineer(Lead)Job Overview:This role requires at least 6 years of experience in data engineering or cloud computing data development.The successful candidate will design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Responsibilities include working with...

  • Senior Data Solutions Engineer

    3 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key ResponsibilitiesDesign, develop and maintain data pipelines and ETL processes on Databricks to ensure high-quality data.Lead the architecture and implementation of scalable, secure and high-performance data solutions that meet business needs.Collaborate with cross-functional teams to gather requirements and deliver actionable insights through data-driven...