Data Engineer II

6 months ago

India tsworks Full time

Who We Are

tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer engagements defined by your skills, ideas, and attitude.


About This Role

tsworks Technologies India Private Limited is seeking driven and motivated Senior Data Engineers to join its Digital Services Team. You will get hands-on experience with projects employing industry-leading technologies. This would initially be focused on the operational readiness and maintenance of existing applications and would transition into a build and maintenance role in the long run.

 

  • Position: Data Engineer
  • Experience: 6+ Years
  • Location: India


Mandatory Required Qualification

  • Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.
  • Expertise in DevOps and CI/CD implementation
  • Good knowledge in SQL
  • Excellent Communication Skills


In This Role, You Will

  • Design, implement, and manage scalable and efficient data architecture on the Azure cloud platform.
  • Develop and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
  • Perform complex data transformations and processing using Azure Data Factory, Azure Databricks, Snowflake's data processing capabilities, or other relevant tools.
  • Develop and maintain data models within Snowflake and related tools to support reporting, analytics, and business intelligence needs.
  • Collaborate with cross-functional teams to understand data requirements and design appropriate data integration solutions.
  • Integrate data from various sources, both internal and external, ensuring data quality and consistency.
  • Ensure data models are designed for scalability, reusability, and flexibility.
  • Implement data quality checks, validations, and monitoring processes to ensure data accuracy and integrity across Azure and Snowflake environments.
  • Adhere to data governance standards and best practices to maintain data security and compliance.
  • Handling performance optimization in ADF and Snowflake platforms
  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.
  • Provide guidance and mentorship to junior team members to enhance their technical skills.
  • Maintain comprehensive documentation for data pipelines, processes, and architecture within both Azure and Snowflake environments including best practices, standards, and procedures.


Skills & Knowledge

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5 + Years of experience in Information Technology, designing, developing and executing solutions.
  • 3+ Years of hands-on experience in designing and executing data solutions on Azure cloud platforms as a Data Engineer.
  • Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.
  • Familiarity with Snowflake data platform would be an added advantage.
  • Hands-on experience in data modelling, batch and real-time pipelines, using Python, Java or JavaScript and experience working with Restful APIs are required.
  • Expertise in DevOps and CI/CD implementation.
  • Hands-on experience with SQL and NoSQL databases.
  • Hands-on experience in data modelling, implementation, and management of OLTP and OLAP systems.
  • Experience with data modelling concepts and practices.
  • Familiarity with data quality, governance, and security best practices.
  • Knowledge of big data technologies such as Hadoop, Spark, or Kafka.
  • Familiarity with machine learning concepts and integration of ML pipelines into data workflows
  • Hands-on experience working in an Agile setting.
  • Is self-driven, naturally curious, and able to adapt to a fast-paced work environment.
  • Can articulate, create, and maintain technical and non-technical documentation.
  • Public cloud certifications are desired.

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    26 minutes ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Engineer II

    4 weeks ago

    India Talentoj Full time

    Role Purpose:The Data Engineer II will play a crucial role in enhancing the data infrastructure and analytics capabilities. This role is vital for building and maintaining data transformation pipelines, monitoring data distribution shifts, managing dataset versions, and analyzing system performance. Contributions in this position will support the continuous...

  • Data Engineer II

    4 weeks ago

    india Talentoj Full time

    Role Purpose:The Data Engineer II will play a crucial role in enhancing the data infrastructure and analytics capabilities. This role is vital for building and maintaining data transformation pipelines, monitoring data distribution shifts, managing dataset versions, and analyzing system performance. Contributions in this position will support the continuous...

  • Data Engineer II

    3 weeks ago

    India Talentoj Full time

    Role Purpose: The Data Engineer II will play a crucial role in enhancing the data infrastructure and analytics capabilities. This role is vital for building and maintaining data transformation pipelines, monitoring data distribution shifts, managing dataset versions, and analyzing system performance. Contributions in this position will support the...

  • Data Engineer II

    3 weeks ago

    india Talentoj Full time

    Role Purpose: The Data Engineer II will play a crucial role in enhancing the data infrastructure and analytics capabilities. This role is vital for building and maintaining data transformation pipelines, monitoring data distribution shifts, managing dataset versions, and analyzing system performance. Contributions in this position will support the...

  • Clinical Data Programmer Ii

    5 months ago

    India Novotech Full time

    **Brief Position Description**: The core responsibility for this position is as a member of the Data Management department at Novotech. The Clinical Data Programmer-II (CDP-II) will be responsible for programming activities on clinical trial projects and to ensure compliance with Good Clinical Data Management Practices (GCDMP). **Minimum Qualifications &...

  • Data Engineer II

    3 weeks ago

    Anywhere in India/Multiple Locations Jumio Full time

    Job Role Summary As a Data Engineer II at Jumio, you will be instrumental in advancing our data engineering processes and infrastructure. Your expertise in building data pipelines, managing datasets, and analyzing system performance will directly impact the efficiency and reliability of our machine learning models. By automating data transformation processes...

  • Software Engineer II

    4 weeks ago

    India Info Services Full time

    Job Title: Software Engineer IIAbout the Role:We are seeking a highly skilled Software Engineer II to join our growing team and contribute to the development and maintenance of our SMARTdiagnostics machine health platform. This platform stores and processes industrial IoT sensor data to provide analytics and insights to our users, helping us achieve our goal...

  • Software Development Engineer II

    1 month ago

    india SuperAGI Full time

    About UsSuperAGI is pioneering the future of Artificial General Intelligence with groundbreaking research and innovative AI products. Our mission is to transform the future of applications through intelligent, autonomous solutions that drive unparalleled efficiency and growth. We are building a world where AI and human intelligence collaborate seamlessly to...

  • Data Scientist-II

    1 month ago

    india Rebel Foods Full time

    About the job Company Description: Rebel Foods, formerly known as Faasos, is the world's largest chain of Online Restaurants. Today we operate 25+ own brands such as Behrouz Biryani, Ovenstory Pizza, Faasos, Sweet Truth on our proprietary operating system, a mix of culinary craft and technology infrastructure. We are now a network of 4000+ Restaurants...

  • Data Scientist-II

    2 months ago

    india Rebel Foods Full time

    About the jobCompany Description:Rebel Foods, formerly known as Faasos, is the world's largest chain of Online Restaurants. Today we operate 25+ own brands such as Behrouz Biryani, Ovenstory Pizza, Faasos, Sweet Truth on our proprietary operating system, a mix of culinary craft and technology infrastructure. We are now a network of 4000+ Restaurants across...

  • Software Development Engineer II

    1 month ago

    India SuperAGI Full time

    About Us SuperAGI is pioneering the future of Artificial General Intelligence with groundbreaking research and innovative AI products. Our mission is to transform the future of applications through intelligent, autonomous solutions that drive unparalleled efficiency and growth. We are building a world where AI and human intelligence collaborate seamlessly...

  • Software development engineer ii

    1 month ago

    India SuperAGI Full time

    About Us Super AGI is pioneering the future of Artificial General Intelligence with groundbreaking research and innovative AI products. Our mission is to transform the future of applications through intelligent, autonomous solutions that drive unparalleled efficiency and growth. We are building a world where AI and human intelligence collaborate...

  • Data engineer ii

    1 month ago

    India Tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Data Engineer II

    1 month ago

    India tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Data Engineer II

    1 month ago

    india tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Data Engineer II

    6 months ago

    India tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Data Engineer II

    2 months ago

    india tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Data Engineer II

    3 months ago

    India tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Lead data engineer

    5 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...