PureSoftware - Data Engineer - PySpark/ETL
3 months ago
Role and Responsibilities :
- Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.
- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory
- Data Modelling and Architecture : Build and optimize data models and structures to support analytics and business requirements.
- Performance Optimization : Monitor, tune, and troubleshoot pipeline performance to ensure efficiency and reliability.
- Collaboration : Partner with business analysts and stakeholders to understand data needs and deliver actionable insights
- Governance : Implement data governance practices, ensuring data quality, security, and compliance with regulations
- Documentation : Develop and maintain comprehensive documentation for data pipelines and architecture
- Testing : Experience in testing and test automation
- Collaborate with cross-functional teams to understand data requirements and provide technical advice.
Mandatory skills :
- Strong background in data engineering, with experience architecting complex data systems in large-scale environments.
- Technical Skills : Proficiency in SQL, Azure Databricks, Blob Storage, Azure Data Factory, programming languages such as Python or Scala, Logic App, and Key Vault.
- Communication : Strong problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full timeJob Overview : PureSoftware Pvt Ltd. is seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our data infrastructure. As a Senior Data Engineer, you will be responsible for designing, developing, and delivering scalable data pipelines using PySpark and ETL workflows.Key Responsibilities :Design and Development-...
-
PureSoftware - Senior Data Engineer - ETL/PySpark
3 months ago
Bengaluru, India PureSoftware Pvt Ltd. Full timeJob Description : Role and Responsibilities : - Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory- Data Modelling and Architecture : Build and optimize data...
-
Data Engineer for Large-Scale Data Systems
2 weeks ago
Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full timeCompany OverviewPureSoftware Pvt Ltd. is a leading technology company that empowers businesses to drive innovation and growth through cutting-edge solutions.Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and delivering large-scale...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Société Générale Assurances Full timeAt Société Générale Assurances, we are seeking a skilled Data Engineer to join our team. As a key member of our technology department, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and ETL concepts.Salary: ₹2,500,000 per annum, commensurate with experience.Job DescriptionWe are...
-
Bengaluru, India PureSoftware Pvt Ltd. Full timeJob Description : GCP Cloud EngineerPureSoftware Technologies Pvt Ltd is seeking a highly skilled and motivated GCP Cloud Engineer to join our team. The ideal candidate will have a deep understanding of Google Cloud Platform (GCP) and will be responsible for designing, implementing, and maintaining our cloud infrastructure to ensure optimal performance and...
-
Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India Careerhaat Full timeWe are seeking a highly skilled Data Engineering Specialist to join our team at Careerhaat, based in Bengaluru. This is a permanent position with company payroll, offering a competitive salary.Job Description:In this role, you will be instrumental in designing, developing, and maintaining ETL processes using Databricks PySpark to extract, transform, and load...
-
Senior PySpark Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Andor Tech Full timeJob Title: Senior PySpark Data EngineerAbout the Role:We are seeking a highly skilled Senior PySpark Data Engineer to join our data engineering team at Andor Tech in Bengaluru. As a key member of our team, you will play a vital role in designing, building, and maintaining large-scale data processing pipelines using Python and PySpark.About You:To succeed in...
-
Data Engineer
3 months ago
Bengaluru, India ANRI Solutions HR Services Full timeJob Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...
-
Azure Data Engineer
1 month ago
Bengaluru, India Juniper Consultancy Services Full timeWho are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...
-
Bengaluru, India Thoucentric Technology Pvt. Ltd. Full timeWe are looking for an experienced AWS Data Engineer to design, develop, and maintain data solutions using core AWS services. The ideal candidate will have hands-on experience with tools like Amazon S3, Redshift, AWS Glue, and DynamoDB, and will build scalable, efficient, and secure data pipelines and architectures. The role also requires strong expertise in...
-
Data Engineer
4 months ago
Bengaluru, India Kratos Gamer Network Full timeRole Description :Join our dynamic and innovative gaming company, where we are committed to creating immersive experiences for players around the world. As we continue to grow, we are seeking a talented AWS Data Engineer to join our team and help us leverage cutting-edge cloud technologies to drive our data initiatives.Key Responsibilities :- Design,...
-
Data Engineer
3 weeks ago
Bengaluru, India NucleusTeq Full timeJob Title: Data Engineer Location: Indore, Bangalore, Raipur Job Type: Full-time Experience: 7-15 Years About the Role: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in PySpark, SQL, and Unix technologies and will be responsible for designing, developing, and...
-
PySpark AWS Data Engineer
3 weeks ago
Bengaluru, India Evnek Technologies Pvt Ltd Full timeJob DescriptionDevelop, implement, and optimize ETL workflows using PySpark/Spark.Utilize AWS services such as Glue, Athena, and S3 for data processing and storage.Build and manage data pipelines to support data-driven applications and analytics.Collaborate with cross-functional teams to design and implement scalable data solutions.Optimize the performance...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer with expertise in PySpark to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing and implementing scalable big data pipelines using PySpark.Key ResponsibilitiesDesign, develop, and deploy complex big data pipelines using...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeJob DescriptionWe are seeking a skilled Big Data Engineer to design and implement ETL pipelines using PySpark for our Data Warehousing projects.A successful candidate should have 3-6 years of experience in working with PySpark, Apache Spark, and Python programming.Key Responsibilities:Develop data processing tasks using PySpark, including reading data,...
-
Senior Python/PySpark Developer
1 month ago
Bengaluru, India Resource Quick Full timeAbout the Role :We are seeking a highly skilled Senior Python/PySpark Developer to lead our data engineering and analytics initiatives. The ideal candidate will have a proven track record in designing, developing, and deploying robust and scalable data solutions on AWS.Key Responsibilities :Data Engineering :- Develop, test, and deploy efficient data...
-
Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full timeJob Title: PureSoftware - Enterprise Cloud Solutions ArchitectOverview: We are seeking a highly skilled Enterprise Cloud Solutions Architect to lead the design and implementation of scalable, reliable, and secure Azure-based solutions.Key Responsibilities:Develop and design Azure-based solutions that align with business requirements and technical...
-
Python Developer With Pyspark
4 weeks ago
Bengaluru, India Andor Tech Full timeJob Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain data...
-
Python Developer With Pyspark
4 weeks ago
Bengaluru, India Andor Tech Full timeJob Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain data...
-
PySpark AWS Data Engineer
3 weeks ago
Bengaluru, India Evnek Technologies Pvt Ltd Full timeDevelop, implement, and optimize ETL workflows using PySpark/Spark.Utilize AWS services such as Glue, Athena, and S3 for data processing and storage.Build and manage data pipelines to support data-driven applications and analytics.Collaborate with cross-functional teams to design and implement scalable data solutions.Optimize the performance of distributed...