Data Engineer with Expertise in Azure and Pyspark
3 weeks ago
We are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to work with our team at AppSierra Solutions Pvt Ltd. The ideal candidate will have strong hands-on experience with SQL and database technologies, proficiency in Pyspark for data processing and analytics, and experience in building and maintaining ETL processes.
Responsibilities- Data Pipeline Design and Development: Design, build, and deploy scalable data pipelines using Azure technologies such as Azure Data Lake, Azure Databricks, and Azure SQL Data Warehouse.
- ETL Process Development and Maintenance: Develop and maintain ETL processes to extract, transform, and load data from different sources into our data warehouse.
- Database Performance Optimization: Optimize database performance and implement efficient data storage and retrieval methods.
- Data Preparation and Model Implementation: Collaborate with data scientists and analysts to understand their data requirements and assist them in data preparation and model implementation.
- Data Quality Monitoring and Troubleshooting: Monitor and troubleshoot data quality issues, ensuring data integrity and consistency.
- Technical Documentation: Develop and maintain technical documentation for data pipelines, ETL processes, and data models.
- Education: Bachelor's degree in Computer Science, Engineering, or a related field.
- Experience: Proven experience as a Data Engineer, with expertise in Azure technologies (Azure Data Lake, Azure Databricks, Azure SQL Data Warehouse).
- Skills: Strong hands-on experience with SQL and database technologies, proficiency in Pyspark for data processing and analytics, and experience in building and maintaining ETL processes.
- Soft Skills: Strong problem-solving and analytical skills, excellent written and verbal communication abilities, and ability to handle multiple tasks and prioritize work effectively.
At AppSierra Solutions Pvt Ltd, we offer a dynamic and supportive work environment, opportunities for continuous learning and growth, and a competitive salary package.
-
Data Engineer Azure Pyspark
3 weeks ago
Hyderabad, Telangana, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: RemoteResponsibilities:As a Data Engineer at Overture Rede Private Limited, you will design, build, and maintain scalable data pipelines using PySpark on Data bricks. You will work with Delta Lake to ensure data reliability, consistency, and scalability. You will utilize Azure Synapse for integrated analytics querying and...
-
Data Engineer Azure Pyspark
4 weeks ago
Hyderabad, Telangana, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Work with Delta Lake to ensure data reliability, consistency, and scalability.Utilize Azure Synapse for integrated analytics querying and big data processing.Develop and deploy data solutions on Azure, including data lakes,...
-
Data Scientist
3 weeks ago
Hyderabad, Telangana, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: Remote or Specify LocationJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters. Additionally, they should have expertise...
-
Data Engineer
2 weeks ago
Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full timeAbout the Role:We are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to design and implement data solutions for our organization. As a Data Engineer, you will work closely with our data scientists and analysts to understand data requirements and ensure the quality, availability, and accessibility of our data.Key...
-
Data Engineer Azure Pyspark
4 weeks ago
Hyderabad, Telangana, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.Monitor and optimize data pipelines for performance and cost efficiency.Requirements:Experience with...
-
AWS/Azure/PySpark Data Engineer
4 weeks ago
Hyderabad, Telangana, India KPI Partners Full timeKey Responsibilities:Lead the development of data engineering solutions using PySpark, Python, and SQL.Design and implement scalable data pipelines on cloud platforms such as Azure and AWS.Collaborate with cross-functional teams to ensure data quality and integrity.Stay up-to-date with industry trends and best practices in data engineering.About the Role:KPI...
-
Data Scientist with PySpark Expertise
4 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob OpportunityDataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark. Your expertise will be crucial in developing innovative data solutions and collaborating with technical teams to drive...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob Title: Data Engineer - Pyspark Databricks SpecialistAbout the RoleRisk Resources LLP is seeking a skilled Data Engineer to join our team. As a Data Engineer - Pyspark Databricks Specialist, you will be responsible for developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Data Engineering Lead
3 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAt UnitedHealth Group, we strive to make the health system work better for everyone. As a Data Engineering Lead, you will play a crucial role in helping us achieve this mission. We are looking for a seasoned professional with expertise in Java, Pyspark, Azure, and Databricks to lead our team of engineers and drive the development of scalable, fault-tolerant...
-
Senior Data Architect with Azure Expertise
7 days ago
Hyderabad, Telangana, India ValueMomentum Full timeValueMomentum is a leading provider of IT Services and Solutions to Insurers, headquartered in New Jersey, US. We are seeking a highly skilled Senior Data Architect with Azure Expertise to join our team.The estimated salary for this position is around $180,000 per annum, based on industry standards and location.About the RoleThis is a senior-level position...
-
Data Engineer with Expertise in PySpark
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full time{"Responsibilities": {"ul": [{"li": "Design and implement robust metadata-driven data ingestion pipelines using PySpark."},{"li": "Collaborate with technical teams to develop innovative data solutions."},{"li": "Work closely with business stakeholders to understand and translate requirements into technical specifications."},{"li": "Conduct unit testing,...
-
Data Engineer with Azure Expertise
4 weeks ago
Hyderabad, Telangana, India Anblicks Full timeAzure Data Engineer RoleAt Anblicks, we are seeking a skilled Azure Data Engineer to join our team. The ideal candidate will have experience in building and implementing robust data pipelines using the Microsoft Stack. Key responsibilities include developing and implementing data pipelines, working with Azure Data Factory, Azure Data Lake, Azure Databricks,...
-
Azure Data Engineer
4 weeks ago
Hyderabad, Telangana, India 2coms Full timeJob Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and implement scalable data ingestion pipelines using...
-
Pyspark Databricks Engineer
3 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...
-
Data Engineer
4 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...
-
Data Scientist with PySpark Expertise
3 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeDataEconomy is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...
-
Pyspark Databricks Engineer
4 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...
-
Azure Data Engineer
3 weeks ago
Hyderabad, Telangana, India KPI Partners Full timeKPI Partners is seeking a skilled Azure Data Engineer to join our team.Key Responsibilities:Data Migration and Processing: Implement data migration and processing using Azure services, Serverless Architecture, Azure Storage, Data Factory, Azure Stream Analytics, Databricks, Azure Data Catalog, and Azure DevOps.Data Pipelines and Streams: Build and optimize...
-
Data Scientist with PySpark Expertise
4 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeDataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...