Senior azure data engineer

6 days ago

Delhi, India Manuh Technologies Full time
Role Summary
The Senior Data Engineer role is responsible for designing, developing and maintaining data pipelines, databases and data infrastructure to enable the efficient data collection, storage and analysis. This role requires collaboration with data scientists, data infrastructure architects and data consumption stakeholders to ensure the availability of high-quality data for insights and decision making is available and will deliver value to the GM strategic vision for the future and meet prioritized business needs. This role drives to deliver innovative solutions with technical fidelity and thrives to work effectively across a cross-functional data and stakeholder ecosystem.
Key Responsibilities:
Design, construct, install and maintain data architectures, including database and large-scale processing systems.
Develop and maintain ELT (Extract, Load, Transform) processes to collect, cleanse and transform data from various sources inclusive of cloud
Design and implement data pipelines to collect, process and transfer data from various sources to storage systems (data warehouses, data lakes, etc.
Implement security measures to protect sensitive data and ensure compliance with data privacy regulations.
Build data solutions that ensure data quality, integrity and security through data validation, monitoring, and compliance with data governance policies
Maintain Master Data, Metadata, Data Management Repositories, Logical Data Models, and Data Standards
Troubleshoot and resolve data-related issues affecting data quality fidelity
· Database Management: Design, optimize, and manage databases to ensure data integrity, performance, and scalability.
· Testing and Quality Assurance: Write unit tests, conduct code reviews, and implement automated testing frameworks to ensure the reliability and stability of applications.
· Continuous Integration and Deployment (CI/CD): Implement CI/CD pipelines using Azure Dev Ops or similar tools to automate build, test, and deployment processes.
· Performance Optimization: Identify and resolve performance bottlenecks, memory leaks, and other issues to ensure optimal application performance.
Qualifications:
Strong skills in SQL, Python, Unix and ability to write efficient ETL on Kubernetes and Cloud platforms specifically Azure and Databricks
Strong understanding and ability to provide mentorship in the areas of data ETL processes and tools for designing and managing data pipelines
Experience with big data frameworks and tools like Apache Hadoop, Apache Spark, or Apache Kafka for processing and analyzing large datasets.
Hands on experience with data serialization formats like JSON, Parquet and XML
Hands on file processing experience dealing with CSV, SPSS and other standard formats
Hands on experience with GIT Repository and Integrating code between Databricks and GIT environments
Consistently designs solutions and build data solutions that are highly automated, performant, with quality checks that provide data consistency and accuracy outcomes
Experience in actively managing large-scale data engineering projects, including planning, resource allocation, risk management, and ensuring successful project delivery and adjust style for all delivery methods (i.e.: Waterfall, Agile, POD, etc.)
Understands data governance principles, data privacy regulations, and experience implementing security measures to protect data
Ability to work effectively in cross-functional teams, collaborate with data scientists, analysts, and stakeholders to deliver data solutions
Influential communication skills to effectively convey technical concepts to non-technical stakeholders and document data engineering processes
Models a mindset of continuous learning, staying updated with the latest advancements in data engineering technologies, and a drive for innovation
·Bachelor’s degree in computer science, Engineering, or a related field. Master's degree preferred.
·5 to 7 years of experience as a Software Engineer with primary focus on Data Engineering.
·Hands-on experience with Azure cloud services, Azure Storage, Azure Dev Ops, etc.

  • Senior Data Integration Engineer | Senior Data Integration Engineer | delhi

    2 weeks ago

    delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...

  • Senior data integration engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Warehouse Engineer | Data Warehouse Engineer | delhi

    2 weeks ago

    delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    2 weeks ago

    Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Senior Azure Data Engineer

    1 month ago

    Delhi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...

  • Azure Data Engineer

    1 month ago

    Delhi, India Hexaware Technologies Full time

    Experience: 6-9 yrsWork location: Bangalore/Pune/ChennaiNotice Period: Immediate - 30 daysSenior Data Engineer - Azure DatabricksWork timing: UK Shift: 1pm IST to 10PM ISTStrong Experience in Azure DBGood Knowledge in PysparkExperience in SQL ServerExperince in Data MigrationExperience in Cloud Migration ( Azure DB )Good CommunicationFlexibility to work with...

  • Senior Azure Data Solutions Engineer

    3 weeks ago

    Delhi, Delhi, India Sopra Steria Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Sopra Steria.About the RoleThis is an excellent opportunity for a seasoned professional with expertise in designing, implementing, and managing large-scale data systems on Azure.Key ResponsibilitiesDesign and develop scalable data architectures using Azure SQL Database (Hyperscale) and...

  • Azure data engineer

    1 month ago

    Delhi, India Hexaware Technologies Full time

    Experience: 6-9 yrsWork location: Bangalore/Pune/ChennaiNotice Period: Immediate - 30 daysSenior Data Engineer - Azure DatabricksWork timing: UK Shift: 1pm IST to 10 PM ISTStrong Experience in Azure DBGood Knowledge in PysparkExperience in SQL ServerExperince in Data MigrationExperience in Cloud Migration ( Azure DB )Good CommunicationFlexibility to work...

  • Senior Data Analytics Engineer

    3 weeks ago

    Delhi, India Strategic Systems Inc Full time

    Need 2 resources immediatelyWould prefer as much overlap with US ET and CT time zones. 2:00 pm IST to 11:00 pm IST shift is acceptable for a candidate that can work independentlyIf the candidate passes the preliminary interview, there will be a live coding exercise as part of the technical screen.Role: Senior Data Analytics Engineer (Azure)Duration: 12...

  • Senior Azure Data Engineer

    5 days ago

    Delhi, India Manuh Technologies Full time

    1. Role SummaryThe Senior Data Engineer role is responsible for designing, developing and maintaining data pipelines, databases and data infrastructure to enable the efficient data collection, storage and analysis. This role requires collaboration with data scientists, data infrastructure architects and data consumption stakeholders to ensure the...

  • Senior Data Analytics Engineer

    3 weeks ago

    Delhi, India Strategic Systems Inc Full time

    1. Need 2 resources immediately2. Would prefer as much overlap with US ET and CT time zones. 2:00 pm IST to 11:00 pm IST shift is acceptable for a candidate that can work independently3. If the candidate passes the preliminary interview, there will be a live coding exercise as part of the technical screen.Role: Senior Data Analytics Engineer (Azure)Duration:...

  • Senior Azure Data Engineer

    4 days ago

    Delhi, Delhi, India Manuh Technologies Full time

    We are seeking an experienced Senior Azure Data Engineer to join our team at Manuh Technologies. As a key member of our data engineering team, you will play a critical role in designing, developing, and maintaining large-scale data pipelines, databases, and data infrastructure to support the collection, storage, and analysis of high-quality data.Job...

  • Senior Azure Data Engineer

    3 weeks ago

    Delhi, Delhi, India IDC TECHNOLOGIES SOLUTIONS INDIA PVT LIMITED Full time

    Azure Data Engineer Role DescriptionIDC Technologies Solutions India Pvt. Limited seeks a skilled Azure Data Engineer to join our team in developing and implementing scalable, secure, and efficient data engineering solutions on Azure.Key Responsibilities:Design, implement, and manage Azure data engineering services including Event Hub, Data Factory, ADLS...

  • Senior Data Engineer

    2 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global IT services company. Our estimated salary range for this position in India is ₹25,00,000 - ₹40,00,000 per annum.Company OverviewTCS is a multinational company with a strong presence in the Indian market. We are committed to delivering high-quality services to our clients and providing a challenging work...

  • Azure data engineer

    2 weeks ago

    Delhi, India Doryo Full time

    As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. Your role will involve working with various stakeholders to understand data requirements, developing data pipelines, and ensuring the reliability and performance of our data infrastructure. If you are a talented data engineer...

  • Senior Azure Data Engineer

    2 days ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Job Title:Senior Azure Data Engineer - Python ExpertCompany Overview:Tata Consultancy Services is a leading IT services company that delivers innovative solutions to clients across the globe.Salary:The estimated salary for this role is ₹3,200,000 - ₹4,800,000 per annum, based on the location in Mumbai and the required skills.Job Description:This role...

  • Senior Azure Data Architect

    6 days ago

    Delhi, Delhi, India Manuh Technologies Full time

    About Manuh TechnologiesManuh Technologies is a leading technology company that provides innovative solutions to businesses. We are currently seeking an experienced Senior Azure Data Engineer to join our team.

  • Azure Data Engineer

    4 weeks ago

    delhi, India Job Conquers Full time

    Company Description we suggest you enter details here Role Description This is a full-time remote role for an Azure Data Engineer at Job Conquers. Client The Azure Data Engineer will be responsible for designing, implementing, and maintaining data pipelines, ETL processes, and data solutions using Azure services. They will collaborate with...