Data Engineering Specialist

1 week ago

Bengaluru, Karnataka, India beBeeDataEngineering Full time
Job Title: Data Engineering Specialist

This role is for a seasoned data engineering professional to design and implement end-to-end data solutions on Azure. The ideal candidate will be responsible for developing, optimizing, and maintaining data pipelines, ensuring data quality and security, and collaborating with cross-functional teams to build scalable data architectures.

Key Responsibilities:
  • Design and implement end-to-end data engineering solutions on Azure, utilizing services like Azure Data Factory (ADF), Azure Databricks, and Synapse Analytics.
  • Develop and maintain data pipelines (ETL) that extract, transform, and load data from various sources into Azure data repositories, including data lakes.
  • Optimize and fine-tune data pipelines for performance, scalability, and cost-efficiency.
  • Automate tasks and deploy production-standard code with unit testing, continuous integration, and versioning.
  • Load transformed data into various destinations, including data warehouses, high-speed indexes, and real-time reporting systems.
  • Ensure data quality and accuracy through testing and validation.
  • Implement data security measures, including encryption, access controls, and auditing.
  • Provide guidance and support for data governance, including metadata management and data lineage.
  • Collaborate with cross-functional teams to understand data requirements and translate them into scalable data architectures.
  • Troubleshoot and resolve data pipeline issues to ensure minimal downtime.
Required Skills and Qualifications:
  • Expertise in ETL (Extract, Transform, Load) processes.
  • Strong skills in Data Analysis and Business Analysis.
  • Hands-on experience with Azure Data Factory (ADF) and Azure Databricks.
  • Proficiency in SQL for data transformation and modeling.
  • Experience with data security measures and data governance.
  • Ability to automate tasks and deploy production-standard code.
  • Strong communication and collaboration skills.

Benefits of the Role: This position offers a unique opportunity to work with cutting-edge technologies, collaborate with talented professionals, and contribute to the development of innovative data solutions.

What We Offer: A dynamic work environment, opportunities for growth and development, and a competitive compensation package.

  • Data Engineering Specialist

    11 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team and contribute to the development of real-time data processing solutions.

  • Data Engineering Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Data Engineering SpecialistAs a seasoned data engineer, you will play a pivotal role in designing, developing, and maintaining high-performance data pipelines and ETL processes on Databricks. You will lead the architecture and implementation of scalable, secure, and efficient data solutions.

  • Digital Engineering Networking Engineer Specialist

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 336414 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore Karn taka IN-KA India IN At...

  • Digital Engineering Networking Engineer Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN).At NTT...

  • Data Engineering Specialist

    21 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 17,32,500 - ₹ 25,95,000

    Job Title:Data Engineering Specialist">This is a challenging opportunity for a skilled Data Engineering Specialist to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing cutting-edge data solutions that drive business growth and improvement.">The ideal candidate will have a deep understanding...

  • Data Engineering Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering Specialist We are seeking an experienced and skilled Data Engineering Specialist to join our team. This is a fantastic opportunity for a talented individual to work on complex data pipelines, ensuring the seamless flow of information across our systems. Responsibilities: Design, develop, and maintain large-scale data processing...

  • Data Engineering Specialist

    13 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,70,00,000

    Job Title: Data Engineering Specialist At our organization, we are seeking a highly skilled data engineering specialist with 4+ years of experience in designing, building, and optimizing ETL pipelines, working with Databricks, and managing large-scale data processing workflows.Key Responsibilities:Design, develop, and maintain scalable ETL pipelines for...

  • Urgent Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Senior Associate Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Data Engineering Specialist

    2 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job OverviewThe role of a Data Engineering Specialist involves the design, development, and maintenance of large-scale data systems. This includes the creation of data pipelines, data warehousing, and data lake architecture.Key Responsibilities:Designing and implementing data pipelines using Azure Data Factory (ADF)Building and managing Spark jobs in PySpark...