PureSoftware - Data Engineer - PySpark/ETL

3 months ago


Bengaluru, India PureSoftware Pvt Ltd. Full time

Role and Responsibilities :

- Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.

- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory

- Data Modelling and Architecture : Build and optimize data models and structures to support analytics and business requirements.

- Performance Optimization : Monitor, tune, and troubleshoot pipeline performance to ensure efficiency and reliability.

- Collaboration : Partner with business analysts and stakeholders to understand data needs and deliver actionable insights

- Governance : Implement data governance practices, ensuring data quality, security, and compliance with regulations

- Documentation : Develop and maintain comprehensive documentation for data pipelines and architecture

- Testing : Experience in testing and test automation

- Collaborate with cross-functional teams to understand data requirements and provide technical advice.

Mandatory skills :

- Strong background in data engineering, with experience architecting complex data systems in large-scale environments.

- Technical Skills : Proficiency in SQL, Azure Databricks, Blob Storage, Azure Data Factory, programming languages such as Python or Scala, Logic App, and Key Vault.

- Communication : Strong problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders

(ref:hirist.tech)
  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full time

    Job Overview : PureSoftware Pvt Ltd. is seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our data infrastructure. As a Senior Data Engineer, you will be responsible for designing, developing, and delivering scalable data pipelines using PySpark and ETL workflows.Key Responsibilities :Design and Development-...


  • Bengaluru, India PureSoftware Pvt Ltd. Full time

    Job Description : Role and Responsibilities : - Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory- Data Modelling and Architecture : Build and optimize data...


  • Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full time

    Company OverviewPureSoftware Pvt Ltd. is a leading technology company that empowers businesses to drive innovation and growth through cutting-edge solutions.Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and delivering large-scale...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Société Générale Assurances Full time

    At Société Générale Assurances, we are seeking a skilled Data Engineer to join our team. As a key member of our technology department, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and ETL concepts.Salary: ₹2,500,000 per annum, commensurate with experience.Job DescriptionWe are...


  • Bengaluru, India PureSoftware Pvt Ltd. Full time

    Job Description : GCP Cloud EngineerPureSoftware Technologies Pvt Ltd is seeking a highly skilled and motivated GCP Cloud Engineer to join our team. The ideal candidate will have a deep understanding of Google Cloud Platform (GCP) and will be responsible for designing, implementing, and maintaining our cloud infrastructure to ensure optimal performance and...


  • Bengaluru, Karnataka, India Careerhaat Full time

    We are seeking a highly skilled Data Engineering Specialist to join our team at Careerhaat, based in Bengaluru. This is a permanent position with company payroll, offering a competitive salary.Job Description:In this role, you will be instrumental in designing, developing, and maintaining ETL processes using Databricks PySpark to extract, transform, and load...


  • Bengaluru, Karnataka, India Andor Tech Full time

    Job Title: Senior PySpark Data EngineerAbout the Role:We are seeking a highly skilled Senior PySpark Data Engineer to join our data engineering team at Andor Tech in Bengaluru. As a key member of our team, you will play a vital role in designing, building, and maintaining large-scale data processing pipelines using Python and PySpark.About You:To succeed in...

  • Data Engineer

    3 months ago


    Bengaluru, India ANRI Solutions HR Services Full time

    Job Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...

  • Azure Data Engineer

    1 month ago


    Bengaluru, India Juniper Consultancy Services Full time

    Who are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...


  • Bengaluru, India Thoucentric Technology Pvt. Ltd. Full time

    We are looking for an experienced AWS Data Engineer to design, develop, and maintain data solutions using core AWS services. The ideal candidate will have hands-on experience with tools like Amazon S3, Redshift, AWS Glue, and DynamoDB, and will build scalable, efficient, and secure data pipelines and architectures. The role also requires strong expertise in...

  • Data Engineer

    4 months ago


    Bengaluru, India Kratos Gamer Network Full time

    Role Description :Join our dynamic and innovative gaming company, where we are committed to creating immersive experiences for players around the world. As we continue to grow, we are seeking a talented AWS Data Engineer to join our team and help us leverage cutting-edge cloud technologies to drive our data initiatives.Key Responsibilities :- Design,...

  • Data Engineer

    3 weeks ago


    Bengaluru, India NucleusTeq Full time

    Job Title: Data Engineer Location: Indore, Bangalore, Raipur Job Type: Full-time Experience: 7-15 Years About the Role: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in PySpark, SQL, and Unix technologies and will be responsible for designing, developing, and...


  • Bengaluru, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionDevelop, implement, and optimize ETL workflows using PySpark/Spark.Utilize AWS services such as Glue, Athena, and S3 for data processing and storage.Build and manage data pipelines to support data-driven applications and analytics.Collaborate with cross-functional teams to design and implement scalable data solutions.Optimize the performance...

  • Big Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer with expertise in PySpark to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing and implementing scalable big data pipelines using PySpark.Key ResponsibilitiesDesign, develop, and deploy complex big data pipelines using...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job DescriptionWe are seeking a skilled Big Data Engineer to design and implement ETL pipelines using PySpark for our Data Warehousing projects.A successful candidate should have 3-6 years of experience in working with PySpark, Apache Spark, and Python programming.Key Responsibilities:Develop data processing tasks using PySpark, including reading data,...


  • Bengaluru, India Resource Quick Full time

    About the Role :We are seeking a highly skilled Senior Python/PySpark Developer to lead our data engineering and analytics initiatives. The ideal candidate will have a proven track record in designing, developing, and deploying robust and scalable data solutions on AWS.Key Responsibilities :Data Engineering :- Develop, test, and deploy efficient data...


  • Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full time

    Job Title: PureSoftware - Enterprise Cloud Solutions ArchitectOverview: We are seeking a highly skilled Enterprise Cloud Solutions Architect to lead the design and implementation of scalable, reliable, and secure Azure-based solutions.Key Responsibilities:Develop and design Azure-based solutions that align with business requirements and technical...


  • Bengaluru, India Andor Tech Full time

    Job Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain data...


  • Bengaluru, India Andor Tech Full time

    Job Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain data...


  • Bengaluru, India Evnek Technologies Pvt Ltd Full time

    Develop, implement, and optimize ETL workflows using PySpark/Spark.Utilize AWS services such as Glue, Athena, and S3 for data processing and storage.Build and manage data pipelines to support data-driven applications and analytics.Collaborate with cross-functional teams to design and implement scalable data solutions.Optimize the performance of distributed...