Senior Data Engineer

4 weeks ago

hyderabad, India Virtusa Full time
Senior Data Engineer - CREQ185313 Description Acts as an Azure Data Factory (ADF) Developer on an agile development team that supports a variety of work types.
This role will be responsible for creating Data orchestration with Azure Data Factory Pipelines & Dataflows. Key role is to understand the business requirements and implement the requirements using Azure Data Factory.
Expert level knowledge on Azure Data Factory
Advance knowledge of Azure ADF, SQL DB, Blog Storage, Synapse Analytics, and other Azure Native Data Services.
Should be able to analyze and understand complex data
Knowledge of Azure data lake is required and Azure Services like Analysis Service, SQL Databases is a must.
Knowledge of master data management, data warehousing and business intelligence architecture.
Experience in data modeling and database design with excellent knowledge of SQL Server best practices.
Excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
Should have clear understanding of DW lifecycle and contribute in preparing Design documents, Unit Test plans, Code review reports.
Experience working in Agile environment (Scrum, Lean, Kanban) is a plus
Knowledge of Big data technologies - Spark Framework, NoSQL, Azure Data Bricks and Haqoop Ecosystem- Hive, Impala, HDFS, YARN, Pig, Oozie is a plus
Writes high quality code within prescribed iterations
Integrate data from different data sources: databases, csv files, xml files, queues
Integrate data for batch, near real-time, real-time latencies
Organize data at different aggregation levels, hierarchies
Write complex data transformation logic in ADF and SQL
Proactively monitor the performance of data jobs and tune the jobs as needed
Make the data integration jobs fault tolerant and scalable
Experience/Knowledge of agile methodology for entire development
Ability to work independently with good verbal & written communication skills
Performs unit testing and acts as a subject matter expert to QA and Business Testers through the testing lifecycle
Develops ADF Jobs while adhering to best practices.
Documents the data extracting/loading mapping processes; documents the data transforming processes; documents the data relationships and maintaining the consistency of the data.
Perform analysis, design, development, and configuration functions (includes defining technical requirements) with a high degree of accuracy and speed, operating as an individual contributor to team goals.
Work independently to tackle well-scoped and loosely scoped problems.
Seek opportunities to expand technical knowledge and capabilities.
Provide technical guidance and mentorship to less experienced employees. Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills Azure Native Data Services Years of Experience 8 Travel No

  • HVAC Engineer

    4 days ago

    Hyderabad, India Magnova Engineer Full time

    Job Requirements Job Title: HVAC EngineerCompany Name: Magnova EngineersLocation: HyderabadSalary: 2.25-3.5 Lacs P.A.Qualification: FreshersJob Description:Kickstart your career as an HVAC Engineer with Magnova Engineers LLP in Vijayawada, Andhra Pradesh. We are seeking enthusiastic freshers to join our team and contribute to innovative projects in the field...

  • Data Engineer

    2 days ago

    hyderabad, India NTT DATA Full time

    Job Description Req ID:  280008  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). "Data...

  • Data Engineer

    1 day ago

    Hyderabad, India NTT DATA Full time

    Job Description Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...

  • Data Engineer

    24 hours ago

    hyderabad, India NTT DATA Full time

    Job Description Req ID:  280024  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data...

  • Data Engineer

    7 hours ago

    hyderabad, India NTT DATA Full time

    Job Description Req ID:  280024  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data...

  • Data Engineer

    20 hours ago

    Hyderabad, India NTT DATA Full time

    Job Description Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...

  • Data Engineer

    2 days ago

    hyderabad, India NTT DATA Services Full time

    Req ID:  280024  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Engineer...

  • Data Engineer

    1 day ago

    Hyderabad, India NTT DATA Services Full time

    Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...

  • Senior Data Engineer

    2 days ago

    Hyderabad, India PrimEra Medical Technologies Full time

    Job Description: Senior Data EngineerAbout PrimEra:PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact.Position Overview:We are seeking a highly skilled Senior...

  • Senior Data Engineer

    4 days ago

    Hyderabad, India PrimEra Medical Technologies Full time

    Job Description: Senior Data EngineerAbout PrimEra:PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact.Position Overview:We are seeking a highly skilled Senior...

  • Senior Data Engineer

    1 month ago

    Hyderabad, India LTIMindtree Full time

    Senior Data EngineerJob Req Id: 1248440 Bachelor’s Degree in Computer Science or a related discipline • 5+ years of applicable engineering experience• Experience in GCP, Big Query• Strong proficiency in Python with an emphasis in building data pipelines• Ability to write complex SQL to perform common types of analysis and aggregations• Experience...

  • Senior Data Engineer

    5 days ago

    Hyderabad, India Zenwork, Inc Full time

    Job Title: Senior Data Engineer - AWS, Redshift, QuickSight Job Description: We seek an experienced Data Engineer to join our team and help optimize our data processing and visualization capabilities. The ideal candidate will have a strong background in data engineering, particularly leveraging AWS products. Roles and...

  • Senior Data Engineer

    1 month ago

    Hyderabad, India Epam Full time

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Senior Data Engineer

    1 month ago

    Hyderabad, India Larsen & Toubro Infotech Ltd Full time

    Senior Data Engineer Job Req Id: 1248440 Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering experience• Experience in GCP, Big Query• Strong proficiency in Python with an emphasis in building data pipelines• Ability to write complex SQL to perform common types of analysis and aggregations •...

  • Senior Data Engineer

    3 weeks ago

    hyderabad, India Zenwork, Inc Full time

    Job Title: Senior Data Engineer - AWS, Redshift, QuickSightJob Description:We seek an experienced Data Engineer to join our team and help optimize our data processing and visualization capabilities. The ideal candidate will have a strong background in data engineering, particularly leveraging AWS products.Roles and Responsibilities:·      Design,...

  • Senior Data Engineer

    1 month ago

    Hyderabad, India Swiss Re Full time

    About the RoleAs a Senior Data Engineer, you will contribute to and support data management activities using most advanced Microsoft Azure technologies. The data management team enables data scientists and data analysts to provide risk knowledge advice and insights as well as data analytics SaaS solutions to Swiss Re clients.Key responsibilities...

  • Senior Data Engineer

    1 month ago

    hyderabad, India LTIMindtree Full time

    Senior Data Engineer Job Req Id: 1248440 Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering experience • Experience in GCP, Big Query • Strong proficiency in Python with an emphasis in building data pipelines • Ability to write complex SQL to perform common types of analysis and aggregations •...

  • Senior Data Engineer

    2 days ago

    hyderabad, India Oracle Full time

    Oracle’s Cloud Infrastructure (OCI) is a comprehensive cloud services offering, spanning Infrastructure as a Service (IaaS), Platform as a Service (PaaS) and Software as a Service (SaaS), and is a strategic growth area for Oracle. OCI can provide you the opportunity to build and operate a suite of large scale, integrated cloud services in a broadly...

  • Senior Data Engineer

    2 days ago

    Hyderabad, India Oracle Full time

    Oracle’s Cloud Infrastructure (OCI) is a comprehensive cloud services offering, spanning Infrastructure as a Service (IaaS), Platform as a Service (PaaS) and Software as a Service (SaaS), and is a strategic growth area for Oracle. OCI can provide you the opportunity to build and operate a suite of large scale, integrated cloud services in a broadly...

  • Senior Data Engineer

    1 month ago

    hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...