Senior Data Engineer

3 weeks ago

India Luxoft Full time

Project Description:

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.

Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities:

• Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

• Design and implement features for identity and access management

• Create authorization frameworks for better access control

• Solve performance issues and scalability issues in the system

• Transaction management with distributed data processing algorithms

• Possess ownership right from start to finish

• Build, monitor, and optimize ETL and ELT processes with data models

• Migrate solutions from on-premises setup to cloud-based platforms

• Understand and implement the latest delivery approaches based on data architecture

• Project documentation and tracking based on understanding user requirements

• Perform data integration with third-party tools including architecting, designing, coding, and testing phases

• Manage documentation of data models, architecture, and maintenance processes

• Continually review and audit data models for enhancement

• Maintenance of ideal data pipeline based on ETL tools.

• Coordination with BI experts and analysts for customized data models and integration

• Code updates, new code development, and reverse engineering

• Performance tuning, user acceptance training, and application support

• Maintain confidentiality of data • Risk assessment, management, and mitigation plans

• Regular engagement with teams for status reporting and routine activities

• Migration activities from one database to another or on-premises to cloud

Mandatory Skills:

5+ years of experience

Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

•Snowflake modeling - roles, databases, schemas

•SQL performance measuring, query tuning, and database tuning

•ETL tools with cloud-driven skills

•Integration with third-party tools

•Ability to build analytical solutions and models.

•Coding in languages like Python, Java, JavaScript

•Root cause analysis of models with solutions

•Hadoop, Spark, and other warehousing tools

•Managing sets of XML, JSON, and CSV from disparate sources

•SQL-based databases like Oracle SQL Server, Teradata, etc.

•Snowflake warehousing, architecture, processing, administration •

•Data ingestion into Snowflake

•Enterprise-level technical exposure to Snowflake applications

Nice-to-Have Skills:

Hadoop, Oracle

Languages:

  • English: B2 Upper Intermediate

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    2 weeks ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    2 weeks ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...

  • Data Warehouse Engineer | Data Warehouse Engineer | india

    2 weeks ago

    india Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    2 weeks ago

    India Data Warehouse Engineer Full time

    Experience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Expert for Analytics Projects

    1 week ago

    India Data Warehouse Engineer Full time

    About the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.

  • Cloud Data Engineering Lead

    7 days ago

    India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • ITI Data | PySpark Data Engineer

    17 hours ago

    india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • Lead data engineer

    3 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Senior Data Infrastructure Architect

    3 days ago

    India OSD Data Services Full time

    About the RoleWe are seeking a highly skilled Senior Data Infrastructure Architect to join our team at OSD Data Services. This is an exciting opportunity to work with cutting-edge technologies and be part of a fast-growing company that's transforming how businesses leverage their data.

  • Lead Data Engineer

    4 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    4 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Senior Data Engineer

    1 month ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: up to 30 LPA iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...

  • Senior data engineer

    4 weeks ago

    India Synechron Full time

    Good-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...

  • Aws data engineer

    2 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Data Platform Engineer

    2 days ago

    India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Data Platform Engineer

    3 days ago

    India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    1 month ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...