Cognine - Data Engineer - SQL/PySpark

1 week ago


Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

Data Engineer (Azure Data Factory and Azure Databricks)Job Description :We seek a Data Engineer with at least 5 years of experience in Azure Databricks, Azure Data Lake Storage gen2 (ADLS), and Azure Data Factory (ADF).The candidate will design, build, and maintain data pipelines using Azure ADF/Databricks.The candidate should be able to create Data Modelling & Governance, they will also work closely with our data science and engineering teams to develop and deploy machine learning models and other advanced analytics solutions.Primary skills : Azure Data Factory, Azure Data Bricks, SQL, ADLS, Spark-SQL, Python (Pandas), Pyspark or Scala.Secondary Skills : Basics of Azure Security (RBAC, Azure AD), Hadoop, HDFS, ADLS, Azure DBFS, PowerBI, and Tableau visualization tool is a plus.Responsibilities :- Design, build, and maintain data pipelines using Azure ADF/Databricks.- Strong expertise in Azure Data Factory, Databricks, and related technologies such as Azure Synapse Analytics and Azure Functions.- Hands-on experience in designing and implementing data pipelines and workflows in Azure Data Factory and Databricks.- Experience in Data Extraction, Transformation, and Loading of data from multiple data sources into target databases, using Azure Databricks, Spark SQL, Pyspark, and Azure SQL.- Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.- Sound working experience in Cleansing, Transformation, Business Logic, Incremental Transformation of Data, and merging the data with datamart tables,.- Developing scalable and reusable frameworks for ingesting data sets.- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.- Interacting with stakeholders and leaders to understand business goals and data requirements.- Experience in working with Agile (Scrum, Sprint) and Waterfall Methodologies.- Collaborate with data engineers, data architects, and business analysts to understand and translate business requirements into technical designs.- Provide technical guidance and support to junior team members.- Design, develop, and maintain SQL databases, including creating database schemas, tables, views, stored procedures, and triggers.- Self-starter and team player with excellent communication, problem-solving skills, and interpersonal skills, and a good aptitude for learning. (ref:hirist.tech)



  • Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Cognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide.Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence.We help organizations modernize IT ecosystems, build AI-powered...


  • Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...

  • ML Engineer

    5 days ago


    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    5 - 10HyderabadFull-TimeCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems,...


  • Hyderabad, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset.As a Great...


  • Hyderabad, Telangana, India Cognine Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About the CompanyCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems, build...

  • Data Engineer

    4 weeks ago


    Hyderabad, India GALAXY I TECHNOLOGIES INC Full time

    Key Responsibilities :- Design, build, and optimize data pipelines leveraging Apache Spark, PySpark, and SQL.- Develop scalable data integration, transformation, and modeling solutions for analytics and reporting.- Implement and manage CI/CD pipelines, release management, and production deployments.- Collaborate with data science teams to enable advanced...


  • Hyderabad, India Fusion Plus Solutions Full time

    Job Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...


  • Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Title: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...


  • Hyderabad, Telangana, India DATAECONOMY Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark Data EngineerExperience: 8 YearsLocation: HyderabadEmployment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache...

  • Data Unveil

    1 week ago


    Hyderabad, India Data Unveil Full time

    Description :About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100+ brands, 100+ data partners and 25+ new drug launches. Our integrated capabilities create a differentiated value...