Analyst - data engineering

4 days ago

Bangalore, India Response Informatics Full time

About the Role: We are seeking a skilled and experienced Data Engineer to join our team and help build, optimize, and maintain data pipelines and architectures. The ideal candidate will have deep expertise in the Microsoft data engineering ecosystem, particularly leveraging tools such as Azure Data Factory, Databricks, Alteryx, Synapse Analytics, Microsoft Fabric, and a strong command of SQL, Python, and Apache Spark. Key Responsibilities:  Design, develop, and optimize scalable data pipelines and workflows using Azure Data Factory, Synapse Pipelines, and Microsoft Fabric.  Responsible for transforming and migrating existing Alteryx workflows into scalable Azure Databricks pipelines, ensuring optimized performance and maintainability.  Collaborate with data engineering and analytics teams to redesign Alteryx pipelines into Spark-based solutions on Azure Databricks, leveraging Delta Lake and Azure services for automation and efficiency.  Build and maintain ETL/ELT processes for ingesting structured and unstructured data from various sources.  Develop and manage data transformation logic using Databricks (Py Spark/Spark SQL) and Python.  Collaborate with data analysts, architects, and business stakeholders to understand requirements and deliver high-quality data solutions.  Ensure data quality, integrity, and governance across the data lifecycle.  Implement monitoring and alerting for data pipelines to ensure reliability and performance.  Work with Azure Synapse Analytics to build data models and enable analytics and reporting.  Utilize SQL for querying and managing large datasets efficiently.  Participate in data architecture discussions and contribute to technical design decisions. Required Skills and Qualifications:  3+ years of experience in data engineering or a related field.  Strong experience in Alteryx workflows and data preparation/ETL processes.  Strong proficiency in the Microsoft Azure data ecosystem including: o Azure Data Factory (ADF) o Azure Synapse Analytics o Microsoft Fabric o Azure Databricks  Solid experience with Python and Apache Spark (including Py Spark).  Advanced skills in SQL for data manipulation and transformation.  Experience in designing and implementing data lakes and data warehouses.  Familiarity with data governance, security, and compliance standards.  Strong analytical and problem-solving skills.  Excellent communication and collaboration abilities. Preferred Qualifications:  Microsoft Azure certifications (e.g., Azure Data Engineer Associate).  Experience with Dev Ops tools and CI/CD practices in data workflows.  Knowledge of REST APIs and integration techniques.  Background in agile methodologies and working in cross-functional teams.

  • Lead Data Engineer

    5 days ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Analyst - Data Engineering

    1 week ago

    Bangalore, India Response Informatics Full time

    About the Role: We are seeking a skilled and experienced Data Engineer to join our team and help build, optimize, and maintain data pipelines and architectures. The ideal candidate will have deep expertise in the Microsoft data engineering ecosystem, particularly leveraging tools such as Azure Data Factory, Databricks, Alteryx, Synapse Analytics,...

  • Data Analyst Lead

    2 weeks ago

    Bengaluru / Bangalore, Chennai, India beBeeData Analyst Full time ₹ 5,00,000 - ₹ 8,00,000

    About the Role","This role is a critical member of our team, working closely with data scientists and product managers to deliver high-quality results. The ideal candidate will have a strong foundation in data analysis and be able to execute on projects and initiatives with minimal supervision.","Our team is responsible for delivering one or more data...

  • Data Analyst

    1 week ago

    Bangalore, India Techmantu Digital Full time

    Techmantu is a 10+ year-old digital media consultancy specializing in strategy, implementation, and operations in digital marketing and skilling. The Shared Services team plays a critical role in supporting multiple practice areas, including Techmantu Marketing and Techmantu Skilling, by enabling seamless operational workflows and ensuring high-quality...

  • Data Analyst

    1 week ago

    bangalore, India Techmantu Digital Full time

    Techmantu is a 10+ year-old digital media consultancy specializing in strategy, implementation, and operations in digital marketing and skilling. The Shared Services team plays a critical role in supporting multiple practice areas, including Techmantu Marketing and Techmantu Skilling, by enabling seamless operational workflows and ensuring high-quality...

  • Analyst - Data Engineering

    1 week ago

    Bangalore, India Response Informatics Full time

    About the Role: We are seeking a skilled and experienced Data Engineer to join our team and help build, optimize, and maintain data pipelines and architectures. The ideal candidate will have deep expertise in the Microsoft data engineering ecosystem, particularly leveraging tools such as Azure Data Factory, Databricks, Alteryx, Synapse Analytics,...

  • Analyst - Data Engineering

    1 week ago

    bangalore, India Response Informatics Full time

    About the Role:We are seeking a skilled and experienced Data Engineer to join our team and help build,optimize, and maintain data pipelines and architectures. The ideal candidate will have deepexpertise in the Microsoft data engineering ecosystem, particularly leveraging tools such asAzure Data Factory, Databricks, Alteryx, Synapse Analytics, Microsoft...

  • Senior Data Analyst

    4 days ago

    bangalore, India Milestone Technologies, Inc. Full time

    We are seeking a Senior Data Analyst / Engineer with strong experience in manufacturing control systems data, data authentication, and readiness engineering. This role will ensure data ingested from manufacturing systems into Client's data lake and downstream applications (e.g., PI) is fit-for-purpose, reliable, and trustworthy. The successful candidate will...

  • Data Analyst

    10 hours ago

    bangalore, India Themesoft Inc. Full time

    Job Title: Data Analyst Location: India (Remote) Duration: Contract Must Have: Data Analyst with SAP Finance Job Description: A data analyst systematically collects, processes, and performs statistical analyses on data sets. Their responsibilities include: 1. Data Cleaning and Preparation: This involves filtering the data, handling missing values, and...

  • Data Analyst

    2 days ago

    bangalore, India Themesoft Inc. Full time

    Job Title: Data AnalystLocation: India (Remote)Duration: Contract Must Have: Data Analyst with SAP FinanceJob Description: A data analyst systematically collects, processes, and performs statistical analyses on data sets. Their responsibilities include:1. Data Cleaning and Preparation: This involves filtering the data, handling missing values, and preparing...