Data Engineer

2 weeks ago

BangaloreHyderabadChennaiPune, IN Nilasu consulting Full time

Responsibilities:

- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.

- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.

- Extract, transform, and load (ETL) data from various sources, ensuring data integrity and accuracy through data mapping, transformation, and validation procedures.

- Implement data quality checks, data profiling, and data cleansing techniques to maintain high data consistency.

- Partner with the data governance team to adhere to data privacy and compliance regulations.

- Leverage cloud platforms (AWS, Azure, Google Cloud) for data management solutions.

- Work effectively with various database management systems (SQL Server, PostgreSQL, DynamoDB, MongoDB).

- Design and build scalable real-time data processing pipelines using Apache Kafka.

- Utilize APIs and microservices to ensure seamless data connectivity across applications and 5+ years of experience leading data migration efforts, preferably in the healthcare industry.

- Expertise in Databricks, Kafka, and Snowflake technologies.

- Familiarity with Azure Data Factory (ADF) (willing to be trained is a plus).

- Experience with data governance practices and compliance regulations.

- Strong understanding of ETL processes and data warehousing concepts.

- Proficiency in data quality checks, profiling, and cleansing techniques.

- Familiarity with cloud-based data solutions (AWS, Azure, Google Cloud) is a plus.

- Knowledge of various database management systems (SQL Server, PostgreSQL, DynamoDB, MongoDB).

- Understanding of data analytics and visualization tools (e.g., Tableau, Power BI) is a plus.

- Experience with Git version control (GitHub).

- Ability to design complex relational databases and manage them efficiently.

- Strong understanding of APIs and microservices architecture.

(ref:hirist.tech)

  • Azure Data Engineer

    2 weeks ago

    Pune/Bangalore/Chennai, IN Growel Softech Pvt. Ltd. Full time

    Job Title : Azure Data EngineerLocations : Pune, Bangalore, ChennaiExperience Required : 4 - 10 yearsJob Description :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with hands-on experience in designing and implementing data solutions using Microsoft Azure....

  • Data Engineer

    2 weeks ago

    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    4 weeks ago

    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • AI/ML Engineer

    2 weeks ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • AI/ML Engineer

    2 months ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • Data Engineer

    2 weeks ago

    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Data Engineer

    2 months ago

    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Lead Data Engineer

    2 weeks ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Lead Data Engineer

    1 month ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Senior Manager/Head

    2 weeks ago

    Chennai/Hyderabad/Bangalore, IN Spectrum Consulting Full time

    Position Overview :As the leader of our Data Engineering team, you will be responsible for driving the design, development, deployment and maintenance of our data architecture, pipelines, and processes across both Azure and AWS cloud environments. You will play a critical role in shaping our data strategy, ensuring scalability, reliability, and efficiency...

  • Senior Manager/Head

    2 weeks ago

    Chennai/Hyderabad/Bangalore, IN Spectrum Consulting Full time

    Position Overview :As the leader of our Data Engineering team, you will be responsible for driving the design, development, deployment and maintenance of our data architecture, pipelines, and processes across both Azure and AWS cloud environments. You will play a critical role in shaping our data strategy, ensuring scalability, reliability, and efficiency...

  • Data Engineer

    2 weeks ago

    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • Data Engineer

    2 weeks ago

    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • Azure Data Engineer

    2 weeks ago

    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Azure Data Engineer

    1 month ago

    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Senior Data Engineer

    2 months ago

    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Aptus Data Labs

    1 week ago

    Bangalore/Hyderabad/Gurgaon/Gurugram/Mumbai, IN Aptus Data Labs Full time

    Description :We are seeking an experienced and talented individual for the position of Data Governance with Azure experience. In this role, you will be responsible for managing the data governance framework using Azure tools and technologies, and collaborating closely with cross-functional teams to implement and maintain best practices.Location :...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad/Bangalore/Pune, IN SKANDHA IT SERVICES PRIVATE LIMITED Full time

    Lead Data Engineer Locations : Hyderabad, Bengaluru, Pune. Skills :- Programming : Python , Pyspark/Scala, Flask.- API Microservices , ECS Fargate.- Bigdata AWS : EMR, Glue, Athena, Redshift, Lambda.- Analytics : AWS Quicksight.- Database : Postgres RDS,Mongo (SQL/NoSQL).- Orchestration : preferably Airflow.About the Role : We are searching for a talented...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    2 weeks ago

    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...