Senior Data Engineer

3 weeks ago

Chennai, India Resource Tree Global Services Full time

Job Name : Senior Data Engineer Azure


Years of Experience : 5


Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating, and helping others, this job is for you


Primary Skills : ADF, Databricks


Secondary Skills : DBT, Python, Databricks, Airflow, Fivetran, Glue, Snowflake


Role Description :


- Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge /involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases


Role Responsibility :


- Translate functional specifications and change requests into technical specifications


- Translate business requirement document, functional specification, and technical specification to related coding


- Develop efficient code with unit testing and code documentation


- Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving


- Setting up the development environment and configuration of the development tools


- Communicate with all the project stakeholders on the project status


- Manage, monitor, and ensure the security and privacy of data to satisfy business needs


- Contribute to the automation of modules, wherever required


- To be proficient in written, verbal and presentation communication (English)


- Co-ordinating with the UAT team


Role Requirement :


- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)


- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)


- Knowledgeable in Shell / PowerShell scripting


- Knowledgeable in relational databases, nonrelational databases, data streams, and file stores


- Knowledgeable in performance tuning and optimization


- Experience in Data Profiling and Data validation


- Experience in requirements gathering and documentation processes and performing unit testing


- Understanding and Implementing QA and various testing process in the project


- Knowledge in any BI tools will be an added advantage


- Sound aptitude, outstanding logical reasoning, and analytical skills


- Willingness to learn and take initiatives


- Ability to adapt to fast-paced Agile environment


Additional Requirement :


- Demonstrated expertise as a Data Engineer, specializing in Azure cloud services.


- Highly skilled in Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics.


- Create and execute efficient, scalable, and dependable data pipelines utilizing Azure Data Factory.


- Utilize Azure Databricks for data transformation and processing.


- Effectively oversee and enhance data storage solutions, emphasizing Azure Data Lake and other Azure storage services.


- Construct and uphold workflows for data orchestration and scheduling using Azure Data Factory or equivalent tools.


- Proficient in programming languages like Python, SQL, and conversant with pertinent scripting languages


(ref:hirist.tech)

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior data engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    4 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    3 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...