Cognine - Data Engineer - SQL/PySpark

1 week ago

Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

Data Engineer (Azure Data Factory and Azure Databricks)Job Description :We seek a Data Engineer with at least 5 years of experience in Azure Databricks, Azure Data Lake Storage gen2 (ADLS), and Azure Data Factory (ADF).The candidate will design, build, and maintain data pipelines using Azure ADF/Databricks.The candidate should be able to create Data Modelling & Governance, they will also work closely with our data science and engineering teams to develop and deploy machine learning models and other advanced analytics solutions.Primary skills : Azure Data Factory, Azure Data Bricks, SQL, ADLS, Spark-SQL, Python (Pandas), Pyspark or Scala.Secondary Skills : Basics of Azure Security (RBAC, Azure AD), Hadoop, HDFS, ADLS, Azure DBFS, PowerBI, and Tableau visualization tool is a plus.Responsibilities :- Design, build, and maintain data pipelines using Azure ADF/Databricks.- Strong expertise in Azure Data Factory, Databricks, and related technologies such as Azure Synapse Analytics and Azure Functions.- Hands-on experience in designing and implementing data pipelines and workflows in Azure Data Factory and Databricks.- Experience in Data Extraction, Transformation, and Loading of data from multiple data sources into target databases, using Azure Databricks, Spark SQL, Pyspark, and Azure SQL.- Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.- Sound working experience in Cleansing, Transformation, Business Logic, Incremental Transformation of Data, and merging the data with datamart tables,.- Developing scalable and reusable frameworks for ingesting data sets.- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.- Interacting with stakeholders and leaders to understand business goals and data requirements.- Experience in working with Agile (Scrum, Sprint) and Waterfall Methodologies.- Collaborate with data engineers, data architects, and business analysts to understand and translate business requirements into technical designs.- Provide technical guidance and support to junior team members.- Design, develop, and maintain SQL databases, including creating database schemas, tables, views, stored procedures, and triggers.- Self-starter and team player with excellent communication, problem-solving skills, and interpersonal skills, and a good aptitude for learning. (ref:hirist.tech)

  • Cognine - Machine Learning Engineer - Artificial Intelligence

    1 week ago

    Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Cognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide.Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence.We help organizations modernize IT ecosystems, build AI-powered...

  • Senior Data Engineer

    5 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...

  • ML Engineer

    5 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    5 - 10HyderabadFull-TimeCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems,...

  • Cognine - Lead.Net Developer - C#/ASP

    2 weeks ago

    Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset.As a Great...

  • Sharepoint Developer

    1 week ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About the CompanyCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems, build...

  • Data Engineer

    4 weeks ago

    Hyderabad, India GALAXY I TECHNOLOGIES INC Full time

    Key Responsibilities :- Design, build, and optimize data pipelines leveraging Apache Spark, PySpark, and SQL.- Develop scalable data integration, transformation, and modeling solutions for analytics and reporting.- Implement and manage CI/CD pipelines, release management, and production deployments.- Collaborate with data science teams to enable advanced...

  • Databricks, SQL, PySpark, Python

    2 days ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...

  • Pyspark Data Engineer

    5 days ago

    Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Title: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...

  • Senior Pyspark Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark Data EngineerExperience: 8 YearsLocation: HyderabadEmployment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache...

  • Data Unveil

    1 week ago

    Hyderabad, India Data Unveil Full time

    Description :About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100+ brands, 100+ data partners and 25+ new drug launches. Our integrated capabilities create a differentiated value...