Senior Data Engineer

5 months ago

Chennai, India Resource Tree Global Services Full time

Details :


Job Name : Senior Data Engineer - Azure

Years of Experience : 4

Job Description :


We are looking for a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating, and helping others, this job is for you

Primary Skills : ADF, Databricks

Secondary Skills : DBT, Python, Databricks, Airflow, Fivetran, Glue, Snowflake

Role Description :

Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.

Role Responsibility :

- Translate functional specifications and change requests into technical specifications

- Translate business requirement document, functional specification, and technical specification to related coding

Develop efficient code with unit testing and code documentation

- Ensuring accuracy and integrity of data and applications through analysis, coding, documenting , testing, and problem solving

- Setting up the development environment and configuration of the development tools

- Communicate with all the project stakeholders on the project status

- Manage, monitor, and ensure the security and privacy of data to satisfy business needs

- Contribute to the automation of modules, wherever required

- To be proficient in written, verbal and presentation communication (English)

- Co-ordinating with the UAT team

Role Requirement :

- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)

- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)

- Knowledgeable in Shell / PowerShell scripting

- Knowledgeable in relational databases, nonrelational databases, data streams, and file stores

- Knowledgeable in performance tuning and optimization

- Experience in Data Profiling and Data validation

- Experience in requirements gathering and documentation processes and performing unit testing

- Understanding and Implementing QA and various testing process in the project

- Knowledge in any BI tools will be an added advantage

- Sound aptitude, outstanding logical reasoning, and analytical skills

- Willingness to learn and take initiatives

- Ability to adapt to fast-paced Agile environment

Additional Requirement :

- Demonstrated expertise as a Data Engineer, specializing in Azure cloud services.

- Highly skilled in Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics.

- Create and execute efficient, scalable, and dependable data pipelines utilizing Azure Data Factory.

- Utilize Azure Databricks for data transformation and processing.

Effectively oversee and enhance data storage solutions, emphasizing Azure Data Lake and other Azure storage services.

- Construct and uphold workflows for data orchestration and scheduling using Azure Data Factory or equivalent tools.

- Proficient in programming languages like Python, SQL, and conversant with pertinent scripting languages

(ref:hirist.tech)

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Architect

    24 hours ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Senior Data Architect**Overview**We are seeking an experienced Senior Data Architect to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...

  • Senior Machine Learning Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...

  • Crayon Data | Senior Software Engineer | chennai

    1 month ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Crayon Data | Senior Software Engineer | chennai

    1 month ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Crayon Data | Senior Software Engineer | chennai

    1 month ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Senior bi engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS Quick Sight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing.Key Responsibilities:Develop and lead the...

  • Senior Software Engineer

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Senior Software Engineer

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Senior software engineer

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Senior Software Engineer

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Senior Software Engineer

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Lead Data Engineer

    24 hours ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...

  • Senior Data Engineering Expert

    9 hours ago

    Chennai, Tamil Nadu, India RAIS USA Full time

    At RAIS USA, we are seeking a highly skilled Senior Data Engineer to join our team.The estimated annual salary for this position is $250,000 - $350,000 depending on location and experience.About the RoleWe are looking for an experienced Senior AWS Data Engineer with expertise in data engineering, cloud services, and DevOps practices. The ideal candidate will...

  • Senior Data Engineering Leader

    5 days ago

    Chennai, Tamil Nadu, India Fedrus global Full time

    Job Title: Senior Data Engineering Leader">Overview:">Fedrus Global is seeking an experienced Senior Data Engineering Leader to design and implement scalable end-to-end data pipelines that integrate and model datasets from various sources. The successful candidate will be responsible for managing the technical scope and architecture of projects before,...

  • Senior Data Engineer

    7 months ago

    Chennai, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...