PureSoftware - Data Engineer - PySpark/ETL
1 month ago
Role and Responsibilities :
- Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.
- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory
- Data Modelling and Architecture : Build and optimize data models and structures to support analytics and business requirements.
- Performance Optimization : Monitor, tune, and troubleshoot pipeline performance to ensure efficiency and reliability.
- Collaboration : Partner with business analysts and stakeholders to understand data needs and deliver actionable insights
- Governance : Implement data governance practices, ensuring data quality, security, and compliance with regulations
- Documentation : Develop and maintain comprehensive documentation for data pipelines and architecture
- Testing : Experience in testing and test automation
- Collaborate with cross-functional teams to understand data requirements and provide technical advice.
Mandatory skills :
- Strong background in data engineering, with experience architecting complex data systems in large-scale environments.
- Technical Skills : Proficiency in SQL, Azure Databricks, Blob Storage, Azure Data Factory, programming languages such as Python or Scala, Logic App, and Key Vault.
- Communication : Strong problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders
-
Bangalore, India PureSoftware Pvt Ltd. Full timeJob Description : Role and Responsibilities : - Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory- Data Modelling and Architecture : Build and optimize...
-
PureSoftware Ltd | Java Backend | bangalore
1 month ago
bangalore, India PureSoftware Ltd Full timeJob Details-Skills and AbilitiesJava (springboot or Quarkus), microservices,MongoDB good to haveCloud (AWS) would be a plusNice-to-Have:1.Exposure to cloud platforms (e.g., AWS)About PuresoftwarePureSoftware partners with global organizations across different focused verticals, including Financial Services, Life Sciences & Healthcare, Telecom &...
-
PureSoftware Ltd | Java Backend | bangalore
1 month ago
bangalore, India PureSoftware Ltd Full timeJob Details-Skills and Abilities Java (springboot or Quarkus), microservices, MongoDB good to haveCloud (AWS) would be a plusNice-to-Have:1.Exposure to cloud platforms (e.g., AWS)About PuresoftwarePureSoftware partners with global organizations across different focused verticals, including Financial Services, Life Sciences & Healthcare, Telecom &...
-
PureSoftware Ltd | Java Backend | bangalore
1 month ago
bangalore, India PureSoftware Ltd Full timeJob Details- Skills and Abilities Java (springboot or Quarkus), microservices, MongoDB good to have Cloud (AWS) would be a plus Nice-to-Have: 1.Exposure to cloud platforms (e.g., AWS) About Puresoftware PureSoftware partners with global organizations across different focused verticals, including Financial Services, Life Sciences & Healthcare, Telecom &...
-
PureSoftware Ltd | System Analyst | bangalore
2 months ago
bangalore, India PureSoftware Ltd Full timeJD Key responsibilities include: · Provide day-to-day operational support for Oracle Health customer’s Citrix environments. · Perform Tech currency and upgrades. · Respond to various Customer Service Request. · Collaborate with project managers and other technical teams. Qualifications: · Experience with both Citrix and Windows Operating systems. ...
-
PureSoftware Ltd | System Analyst | bangalore
2 months ago
bangalore, India PureSoftware Ltd Full timeJDKey responsibilities include: · Provide day-to-day operational support for Oracle Health customer’s Citrix environments. · Perform Tech currency and upgrades. · Respond to various Customer Service Request. · Collaborate with project managers and other technical teams. Qualifications: · Experience with both Citrix and Windows Operating systems. ·...
-
PureSoftware Ltd | System Analyst | bangalore
2 months ago
bangalore, India PureSoftware Ltd Full timeJD Key responsibilities include: · Provide day-to-day operational support for Oracle Health customer’s Citrix environments. · Perform Tech currency and upgrades. · Respond to various Customer Service Request. · Collaborate with project managers and other technical teams. Qualifications: · Experience with both Citrix and Windows Operating systems. ...
-
Bangalore, India PureSoftware Pvt Ltd. Full timeJob Description : GCP Cloud EngineerPureSoftware Technologies Pvt Ltd is seeking a highly skilled and motivated GCP Cloud Engineer to join our team. The ideal candidate will have a deep understanding of Google Cloud Platform (GCP) and will be responsible for designing, implementing, and maintaining our cloud infrastructure to ensure optimal performance and...
-
Azure Data Engineer
3 weeks ago
Bangalore, India Juniper Consultancy Services Full timeWho are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...
-
Data Engineer
1 month ago
Bangalore/Hyderabad, India ANRI Solutions HR Services Full timeJob Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...
-
Data Engineer
2 months ago
Bangalore/Chennai, India TekPillar Full timeJob Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, Python Job Description : We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience. - Strong experience with AWS services:...
-
Python Developer With Pyspark
2 months ago
bangalore, India Andor Tech Full timeJob Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain...
-
Senior Python/PySpark Developer
4 days ago
Bangalore, India Resource Quick Full timeAbout the Role :We are seeking a highly skilled Senior Python/PySpark Developer to lead our data engineering and analytics initiatives. The ideal candidate will have a proven track record in designing, developing, and deploying robust and scalable data solutions on AWS.Key Responsibilities :Data Engineering :- Develop, test, and deploy efficient data...
-
Data Engineer-ETL
1 hour ago
Bangalore, India Ubique Systems Full timeWe’re Hiring: Data Engineer III Location: Flexible / Hybrid About the Role We’re looking for a highly skilled Data Engineer to join our team and lead the development of innovative data solutions. If you have expertise in ETL processes , Azure data services , and data warehouse architecture , this is your chance to work on...
-
Python/PySpark Developer
4 days ago
Bangalore, India Resource Quick Full timeKey Responsibilities : - Develop robust and scalable Python and PySpark applications to support data engineering and analytics initiatives.- Design and deploy cloud-native solutions on AWS, leveraging services like EC2, Lambda, S3, RDS, Redshift, and Glue.- Manage and transform large datasets, ensuring efficient data ingestion and migration through...
-
Ubique Systems | Data Engineer-ETL
3 hours ago
bangalore, India Ubique Systems Full timeWe’re Hiring: Data Engineer IIILocation: Flexible / HybridAbout the RoleWe’re looking for a highly skilled Data Engineer to join our team and lead the development of innovative data solutions. If you have expertise in ETL processes , Azure data services , and data warehouse architecture , this is your chance to work on cutting-edge projects that...
-
Data Engineer
1 month ago
Bangalore, India MAYNOR CONSULTING Full timeJob Description :- BE/BTech with 5-7 Years of Experience- Azure Data Factory - Azure Databricks (Spark) - Azure Data Lake- ETL/ELT pipelines- Azure Analysis Services - Azure SQL Database Required Skills - Minimum 1 year of Hands on experience of Azure Big Data Stack- Minimum 3 Years of Hands-on experience developing, Solid knowledge of Data Modelling,...
-
Principal Data Engineer
1 month ago
Bangalore, India gethyr Full timeResponsibilities : Data Pipeline Development : Design, implement, and maintain scalable data pipelines using PySpark to process and transform large datasets efficiently. Workflow Orchestration : Develop, schedule, and monitor complex data workflows and ETL processes using Apache Airflow. Data Management : Manage and optimize data storage solutions,...
-
Innovatily - Data Engineer - ETL Pipeline
3 weeks ago
Bangalore, India Innovatily Pvt. Ltd Full timeAbout Us : Innovatily is dedicated to transforming data into actionable insights. We leverage cutting-edge technologies like Apache Spark and AWS Glue to build robust, scalable ETL pipelines that support our diverse data processing needs. We are seeking talented ETL Developers to join our team and help us scale our data infrastructure.Job Description : As an...
-
Senior Data Engineer
4 days ago
Bangalore, India Careerhaat Full timeJob Location : - Bengaluru (hybrid)Permanent position with company payroll Job Description : We are looking for a highly skilled Databricks PySpark Developer to join our data platform implementation team. In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and...