Cognine - Data Engineer - SQL/PySpark
1 week ago
Data Engineer (Azure Data Factory and Azure Databricks)Job Description :We seek a Data Engineer with at least 5 years of experience in Azure Databricks, Azure Data Lake Storage gen2 (ADLS), and Azure Data Factory (ADF).The candidate will design, build, and maintain data pipelines using Azure ADF/Databricks.The candidate should be able to create Data Modelling & Governance, they will also work closely with our data science and engineering teams to develop and deploy machine learning models and other advanced analytics solutions.Primary skills : Azure Data Factory, Azure Data Bricks, SQL, ADLS, Spark-SQL, Python (Pandas), Pyspark or Scala.Secondary Skills : Basics of Azure Security (RBAC, Azure AD), Hadoop, HDFS, ADLS, Azure DBFS, PowerBI, and Tableau visualization tool is a plus.Responsibilities :- Design, build, and maintain data pipelines using Azure ADF/Databricks.- Strong expertise in Azure Data Factory, Databricks, and related technologies such as Azure Synapse Analytics and Azure Functions.- Hands-on experience in designing and implementing data pipelines and workflows in Azure Data Factory and Databricks.- Experience in Data Extraction, Transformation, and Loading of data from multiple data sources into target databases, using Azure Databricks, Spark SQL, Pyspark, and Azure SQL.- Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.- Sound working experience in Cleansing, Transformation, Business Logic, Incremental Transformation of Data, and merging the data with datamart tables,.- Developing scalable and reusable frameworks for ingesting data sets.- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.- Interacting with stakeholders and leaders to understand business goals and data requirements.- Experience in working with Agile (Scrum, Sprint) and Waterfall Methodologies.- Collaborate with data engineers, data architects, and business analysts to understand and translate business requirements into technical designs.- Provide technical guidance and support to junior team members.- Design, develop, and maintain SQL databases, including creating database schemas, tables, views, stored procedures, and triggers.- Self-starter and team player with excellent communication, problem-solving skills, and interpersonal skills, and a good aptitude for learning. (ref:hirist.tech)
-
Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full timeCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide.Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence.We help organizations modernize IT ecosystems, build AI-powered...
-
Senior Data Engineer
5 days ago
Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...
-
ML Engineer
5 days ago
Hyderabad, Telangana, India Cognine Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year5 - 10HyderabadFull-TimeCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems,...
-
Cognine - Lead.Net Developer - C#/ASP
2 weeks ago
Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full timeCompany DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset.As a Great...
-
Sharepoint Developer
1 week ago
Hyderabad, Telangana, India Cognine Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAbout the CompanyCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems, build...
-
Data Engineer
4 weeks ago
Hyderabad, India GALAXY I TECHNOLOGIES INC Full timeKey Responsibilities :- Design, build, and optimize data pipelines leveraging Apache Spark, PySpark, and SQL.- Develop scalable data integration, transformation, and modeling solutions for analytics and reporting.- Implement and manage CI/CD pipelines, release management, and production deployments.- Collaborate with data science teams to enable advanced...
-
Databricks, SQL, PySpark, Python
2 days ago
Hyderabad, India Fusion Plus Solutions Full timeJob Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...
-
Pyspark Data Engineer
5 days ago
Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 5,00,000 - ₹ 15,00,000 per yearTitle: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...
-
Senior Pyspark Data Engineer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: PySpark Data EngineerExperience: 8 YearsLocation: HyderabadEmployment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache...
-
Data Unveil
1 week ago
Hyderabad, India Data Unveil Full timeDescription :About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100+ brands, 100+ data partners and 25+ new drug launches. Our integrated capabilities create a differentiated value...