PureSoftware - Senior Data Engineer - ETL/PySpark

2 months ago


Bangalore, Karnataka, India PureSoftware Pvt Ltd. Full time

Job Description :


Role and Responsibilities :


- Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.

- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory

- Data Modelling and Architecture : Build and optimize data models and structures to support analytics and business requirements.

- Performance Optimization : Monitor, tune, and troubleshoot pipeline performance to ensure efficiency and reliability.

- Collaboration : Partner with business analysts and stakeholders to understand data needs and deliver actionable insights

- Governance : Implement data governance practices, ensuring data quality, security, and compliance with regulations

- Documentation : Develop and maintain comprehensive documentation for data pipelines and architecture

- Testing : Experience in testing and test automation

- Collaborate with cross-functional teams to understand data requirements and provide technical advice.

Qualifications :


- Experience Level : Extensive experience (at least 4yrs+) in Azure Databricks, Unity Catalog, Azure Data Factory, Azure DevOps Delta Lakes, DevSecOps, NFRs (Non-Functional Requirements); experience in insurance domain desirable

- Education Level : Bachelor's or master's degree in computer science, Information Technology, Data Science or a related relevant field.

- Certification in Azure Data Engineer Associate or similar, and experience with additional Azure services (e.g., Azure Synapse Analytics, Azure SQL Database)

- Personal Attributes : Strong analytical skills, leadership capabilities, effective communication, and problem-solving ability

Mandatory skills :


- Strong background in data engineering, with experience architecting complex data systems in large-scale environments.

- Technical Skills : Proficiency in SQL, Azure Databricks, Blob Storage, Azure Data Factory, programming languages such as Python or Scala, Logic App, and Key Vault.

- Communication : Strong problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders

(ref:hirist.tech)

  • Bangalore, Karnataka, India PureSoftware Pvt Ltd. Full time

    Role and Responsibilities :- Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory- Data Modelling and Architecture : Build and optimize data models and...


  • Bangalore, Karnataka, India PureSoftware Pvt Ltd. Full time

    Job Description : GCP Cloud EngineerPureSoftware Technologies Pvt Ltd is seeking a highly skilled and motivated GCP Cloud Engineer to join our team. The ideal candidate will have a deep understanding of Google Cloud Platform (GCP) and will be responsible for designing, implementing, and maintaining our cloud infrastructure to ensure optimal performance and...

  • ETL Developer

    1 month ago


    Bangalore, Karnataka, India Zenotis Group Full time

    Job Requirement :- Develop and Maintain ETL Pipelines : Design, develop, and implement scalable ETL workflows using PySpark, Python, and AWS Glue, Databricks.- Data Transformation and Integration : Extract, transform, and load data from various sources to AWS S3 and Redshift.- Performance Optimization : Identify and resolve performance bottlenecks in ETL...

  • Data Engineer

    2 months ago


    Bangalore/Hyderabad, Karnataka, India ANRI Solutions HR Services Full time

    Job Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Expian Technologies Pvt Ltd Full time

    SALARY : 30LPA - 40LPAPEI Group is a subscriber-focused business intelligence company that focuses on private investment markets in real estate, infrastructure, private equity, private debt, and specialist sector-specific activities within private asset classes. We provide industry-leading journalism, data, and market insight to subscribing clients via a...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India MAYNOR CONSULTING Full time

    Job Description :- BE/BTech with 5-7 Years of Experience- Azure Data Factory - Azure Databricks (Spark) - Azure Data Lake- ETL/ELT pipelines- Azure Analysis Services - Azure SQL Database Required Skills - Minimum 1 year of Hands on experience of Azure Big Data Stack- Minimum 3 Years of Hands-on experience developing, Solid knowledge of Data Modelling,...


  • Bangalore, Karnataka, India GetHyr Full time

    Responsibilities : Data Pipeline Development : Design, implement, and maintain scalable data pipelines using PySpark to process and transform large datasets efficiently.Workflow Orchestration : Develop, schedule, and monitor complex data workflows and ETL processes using Apache Airflow.Data Management : Manage and optimize data storage solutions, ensuring...

  • Senior Data Engineer

    2 months ago


    Bangalore, Karnataka, India ScaleOrange Technologies Pvt Ltd Full time

    Company Description : ScaleOrange Technologies Pvt Ltd. Role Description : This is a full-time on-site role for a Senior Data Engineer with 5+ years of experience at ScaleOrange Technologies Pvt Ltd in Hyderabad. The Senior Data Engineer will be responsible for data engineering, data modeling, ETL processes, data warehousing, and data analytics on a...

  • AWS Data Engineer

    4 weeks ago


    Bangalore/Hyderabad, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    Description :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Position : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India Mantra Labs Pvt Ltd Full time

    Job Title : Data EngineerJob Description : Mantra Labs is looking for highly motivated data engineers who have experience in as good in Database and SQL, Good in Python,- Building data pipelines with ETL/ELT preferably open source and cloud based tools.- DBT, AWS Lambda Functions, AWS Glue- Data Replication, Migration and Change Data Capture- Data Modelling,...


  • Bangalore, Karnataka, India Wenger & Watson Inc. Full time

    Industry : General Insurance. Role : Data Engineering Manager. Years of Experience : 12-15 Years. Location : Banglore(koramangala). Work mode : WFO(1st and last saturday working half day). Other location : candidate willing to relocate. Purpose : This role will own the data ingestion, storage, and engineering processes and functions on the data platform. The...

  • AWS Data Engineer

    2 months ago


    Bangalore, Karnataka, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Role : AWS Data Engineer. Experience : 6+ Years. Location : Bangalore (Work from office 5 Days). Job Description : AWS Data Engineer/Lead Developer- ,experience with Sql, S3, AWS Glue, AWS Lambda, Pyspark, Aurora DB, Dynamo DB, Redshift, Datawarehousing, CI/CD, Stonebranch(Scheduling Tool).- We are seeking a highly skilled AWS Data Engineer to join our team...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India Ample Success Hr Solutions Full time

    Qualifications : Minimum Qualifications:- Bachelor's Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field).- 5 years of experience in Data Engineering, Data Lake, Data Mesh, Data Warehousing/ETL.- 5 years of experience working on project(s) involving the implementation of solutions applying...

  • PySpark Developer

    2 months ago


    Bangalore, Karnataka, India Rigel networks Full time

    Job Title - Pyspark DeveloperLocation : Bangalore G.P.O., Karnataka Job Description :Lead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India NAM Info Inc Full time

    Job Title : Data Engineer. Location : Bangalore. Experience Level : 6- 8 years. Employment Type : Full-time with NAM INFO PVT LTD. Shift timings : Rotational Shift (should be able to support 24 x 7). Workdays : 5 days a week. Job Description : We are looking for experienced and talented Senior Data Engineers to join our team in Bangalore. As a Senior Data...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India BYTESPRINT TALENT SEARCH LLP Full time

    Role Overview :- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Company Description : JoulestoWatts Business Solutions is a global IT services and consulting enterprise headquartered in Texas, USA. With over 4,000 professionals serving 200+ clients across 5 countries, we are recognized as a certified Great Place to Work (GPTW). Our focus is on delivering state-of-the-art solutions across diverse domains. Role Description...

  • Senior ETL Developer

    4 weeks ago


    Bangalore, Karnataka, India Lancesoft India Pvt Ltd Full time

    We are seeking a highly skilled Senior ETL Developer to join our team and play a crucial role in designing, developing, and optimizing ETL processes. The ideal candidate will have a strong foundation in T-SQL, ETL tools, and RDBMS concepts, along with a passion for data engineering and a commitment to delivering high-quality solutions. Key Responsibilities :...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India DIATOZ Solutions Pvt ltd., Full time

    Role Description :This is a full-time hybrid role for a Data Engineer at DIATOZ. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics. The role is primarily located in Bengaluru with flexibility for remote work.Experience : 2.5 to 5 yearsKey Responsibilities : Data...