Data Engineer
3 weeks ago
Job Summary: We are seeking a highly skilled Data Engineer to join our team at Nuviso Networks. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Azure Databricks.
Key Responsibilities:
- Design and Develop Data Pipelines: Utilize Azure Databricks to design and develop efficient data pipelines, ensuring seamless data flow and minimal latency.
- ETL Process Implementation: Implement ETL processes to ingest and transform data from various sources, ensuring accuracy and reliability.
- Data Management: Develop and maintain Delta Lake tables for efficient data storage and retrieval, ensuring data quality and integrity.
- Collaboration and Communication: Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions, participating in design and code reviews to maintain high development standards.
- Azure Integration: Integrate Databricks workflows with other Azure services, such as Azure Data Lake Storage, Azure SQL Database, and Azure Data Factory, ensuring reliable and consistent data availability.
- Continuous Improvement: Stay up-to-date with the latest developments in Azure Databricks, identify opportunities to improve data processing efficiency, and reduce operational costs, implementing best practices for data engineering and contributing to the team's knowledge base.
Requirements:
- Technical Skills:
- 5+ years of experience in data engineering or a related field.
- Extensive experience with Azure Databricks.
- Strong proficiency in SQL for data manipulation and querying.
- Experience with Delta Lake and data versioning.
- Knowledge of Azure Data Lake Storage, Azure Data Factory, and other Azure services.
- Proficiency in programming languages such as Python or Scala.
Professional Skills:
- Problem-Solving and Analytical Skills: Excellent problem-solving and analytical skills, with the ability to work in a fast-paced, dynamic environment.
- Communication and Collaboration Skills: Strong communication and collaboration skills, with the ability to work closely with data scientists, analysts, and business stakeholders.
Preferred Qualifications:
- Additional Skills:
- Experience with Databricks MLflow for machine learning workflows.
- Knowledge of data warehousing concepts and solutions such as Snowflake or Azure Synapse Analytics.
- Familiarity with CI/CD pipelines and version control systems like Git.
- Experience in Agile development methodologies.
About Nuviso Networks: Nuviso Networks is a leading technology company that provides innovative solutions for data engineering and management. We are committed to delivering high-quality solutions that meet our clients' needs, and we are seeking a highly skilled Data Engineer to join our team.
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Data Engineer
3 weeks ago
Hyderabad, India NTT DATA Full timeJob Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...
-
Big Data Engineer, Data Modeling Expert
4 weeks ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...
-
Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India NTT DATA Full timeJob SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...
-
Data Engineer
3 weeks ago
Chennai, India NTT DATA Full timeJob Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...
-
Big Data Engineer, Data Modeling Expert
4 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...
-
Data Engineer
2 months ago
Hyderabad, India NTT DATA Services Full timeRole Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...
-
Data Engineer
1 month ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...
-
Director of Data Engineering
1 month ago
Chennai, India Wavicle Data Solutions Full timeJob description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals....
-
Data Engineering Leader
4 weeks ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeJob Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...
-
Data Engineer
3 weeks ago
Chennai, India NTT DATA Services Full timeReq ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...
-
Senior Data Engineer
4 weeks ago
chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
2 weeks ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Data Engineer
4 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...
-
Chief Data Science Engineer
5 days ago
Chennai, Tamil Nadu, India NTT DATA Full timeJob SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...
-
Senior Data Engineer
4 weeks ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
1 month ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
4 weeks ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...