Highly Skilled Data Engineer

5 days ago

Kolkata Hyderabad Secunderabad Telangana Mumbai, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

**Azure Data Engineer Role**

We are seeking a skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Python, SQL, and Kedro.

Key Responsibilities:

  • Data Pipeline Development: Design and develop efficient data pipelines using Python, SQL, and Kedro to process and transform large datasets.
  • Serverless Solutions: Implement serverless solutions using AWS Lambda and Step Functions to improve scalability and reduce costs.
  • Data Workflow Management: Develop and manage data workflows in Azure and AWS cloud environments to ensure seamless data integration and processing.
  • Integration and API Development: Create integrations between data systems and Power Platform (Power Apps, Power Automate) and design, develop, and maintain APIs for data exchange and integration.
  • Data Extraction and Storage: Implement solutions to extract data from APIs and store in databases (Dataverse & PostgreSQL) to optimize data storage and retrieval processes.

Required Skills and Experience:

  • Azure Expertise: Expert in Azure Data Engineer role with ability to build solutions in Power Platform environment, AWS cloud, and Azure cloud services.
  • Integration Knowledge: Good knowledge on integration like API, XML with ADF, Logic App, Azure Functions, AWS Step functions, and AWS Lambda Functions.
  • Programming Languages: Strong proficiency in Python, Pyspark (especially Kedro Framework), and SQL.
  • Additional Skills: Having knowledge and experience in Scala, Java, and R would be a good to have skill.
  • Kedro Framework: Experience with Kedro framework for data engineering pipelines.
  • AWS Services: Expertise in AWS services, particularly Lambda and Step Functions.
  • Power Platform: Proven experience with Power Platform (Power Apps, Power Automate) and Dataverse.
  • API Development: Strong understanding of API development and integration.
  • Database Design: Experience in database design and management.
  • Skillset: Excellent problem-solving and communication skills.

  • Highly Skilled Data Solutions Engineer

    6 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job DescriptionAs a highly skilled Data Solutions Engineer, you will play a key role in designing and implementing data solutions on the Databricks platform. You will be responsible for developing and deploying scalable and reliable data pipelines using Apache Spark and other big data technologies.",

  • Highly Skilled Data Engineer

    22 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Senior AnalystAbout the Role:We are seeking an experienced Data Engineering Senior Analyst to join our team. The ideal candidate will have a strong background in data engineering, excellent communication skills, and the ability to work collaboratively with cross-functional teams.Responsibilities:Full Stack Engineers are able to...

  • Highly Skilled Enterprise Data Specialist

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Enterprise Data EngineerWe are seeking a highly skilled Enterprise Data Engineer to join our team. As an Enterprise Data Engineer, you will be responsible for designing and implementing data pipelines, managing transactions with distributed data processing algorithms, and ensuring system scalability.Key Responsibilities:Design and implement data pipelines...

  • Highly Skilled Data Solutions Architect

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. This is an excellent opportunity for a motivated and experienced professional to work on cutting-edge projects and contribute to the growth and success of our organization.The successful candidate will be responsible for designing, developing, and implementing scalable data...

  • Highly Skilled Data Engineer

    5 days ago

    Hyderabad / Secunderabad, Telangana, Delhi, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    As a data engineer, you will play a pivotal role in unlocking the value of big data for our organization.Key Responsibilities:Liaising with coworkers and clients to clarify requirements for each task.Designing and implementing infrastructure that enables seamless access and analysis of large datasets.Refining existing frameworks to optimize their...

  • Highly Skilled Software Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeSoftware Full time US$ 90,000 - US$ 1,20,000

    Job OverviewWe are seeking a highly skilled software professional to join our team as a Full Stack Developer. This role involves designing, developing, testing, deploying, maintaining, and improving software using Microsoft technologies.Design and develop scalable software applications using C# and .NetCreate new data connector wrappers to integrate with 3rd...

  • Highly Skilled QA Engineer

    5 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeQuality Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled and experienced Lead QA Engineer to join our team. The successful candidate will be responsible for designing, implementing and maintaining testing processes and procedures that ensure the highest level of quality.The ideal candidate will have a strong background in software testing and development, with...

  • Highly Skilled Data Engineer Wanted

    21 hours ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 4,00,000 - ₹ 8,00,000

    Data Engineering OpportunityWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.

  • Highly Skilled Data Engineer

    6 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title:A highly skilled Data Engineer is required to lead our data engineering initiatives.Design and implement efficient data models using Snowflake DB, ensuring seamless data processing and querying.Develop and maintain complex SQL queries to extract valuable insights from large datasets.Manage data pipelines, integrating various systems with...

  • Highly Skilled Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job OverviewThis role involves leading the development and management of real-time data streaming using Apache Kafka, as well as building and automating data applications with Python and Java."],