Data Engineer

3 weeks ago


Anywhere in IndiaMultiple Locations, IN IT Source Global Full time

Role : Data Engineer

Job Description :

- Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.

- Work extensively with AWS services such as Amazon S3 for data storage and Athena for querying and analyzing structured and unstructured data.

- Develop and manage data processing and transformation jobs in Azure Databricks, leveraging Apache Spark and Delta Lake.

- Collaborate with data architects and business stakeholders to design and implement scalable data lakes, data warehouses, and data marts across cloud platforms.

- Optimize and automate the movement of data between cloud environments (AWS and Azure), ensuring data quality and security at every stage.

- Use Kubernetes to orchestrate and manage containerized data processing workflows, ensuring fault tolerance and scalability of distributed applications.

- Implement CI/CD pipelines for continuous integration and deployment of data workflows using tools like Azure DevOps or GitLab.

- Troubleshoot and resolve complex data processing issues and optimize performance of data pipelines across Azure Databricks, PySpark, and Athena environments.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN beansbit Full time

    Salary : 25 - 40 LPAJob Description : We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full time

    Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full time

    We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer,Mandatory Skills :- Databricks(PySpark, Scala)- Data Factory/Synapse- SQL DB and DW- Working knowledge on Git Roles and Responsibilities :Requirements :- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.- Good...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Vysystems Full time

    Data Engineer Need short joinersJob Location : Bangalore - Manyata Tech ParkMode : Hybrid.Experience : 4-8 yearsJob Description : We are looking for a skilled Data Engineer with expertise in Azure Data Factory, Azure Databricks, PySpark, Snowflake, and SQL. The ideal candidate will play a key role in designing, building, and maintaining scalable data...

  • Data Quality Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job Summary :We are seeking a detail-oriented and analytical Data Quality Engineer to join our team. The ideal candidate will be responsible for ensuring the accuracy, integrity, and reliability of our data across various systems. You will work closely with data engineers, data scientists, and other stakeholders to implement data quality processes and...

  • DevOps & Data Engineer

    5 months ago


    Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations, IN Machine Minds Full time

    Job Description : Data EngineerThe Position : We are seeking an experienced Data Engineer to join our team of passionate professionals working on cutting-edge technology. In this role, you will be responsible for the ELT of Canibuild data using Python, Airflow, and SQL within an AWS environment. Additionally, you will create and maintain data visualizations...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Risk Resources LLP Full time

    Overview :The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN MindBrain Full time

    Job Title : Data Engineer. Location : Remote. Experience : 6+ Years. Contract : 6 Months (Extendable). Skills Required : - Python : Extensive experience in Python for advanced data manipulation, automation, and scripting. - SQL : Expertise in SQL for complex querying, database management, and performance optimization. - Databricks : Proficient in using...

  • Lead Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    Job Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...

  • Technical Lead

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job Summary :We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, and ensuring data integrity, security, and performance. Oversee technical aspects of data integration and...

  • Lead Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN Talentoj Full time

    Requirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write unit tests...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN TalenTECH Solutions Private Limited Full time

    Technical/Functional Skills :Must have :- 5+ years of experience working in data warehousing systems- Strong experience in Oracle Fusion ecosystem, with strong data-extracting experience using Oracle BICC/BIP.- Must have good functional understanding of Fusion data structures.- Must have strong and proven data engineering experience in big data / Databricks...


  • Anywhere in India/Multiple Locations, IN TETRAHED INC Full time

    Qualifications, Skills And Experience :- 6+ years of hands-on experience in Data Engineering roles, with a focus on data integration and ETL.- Must have proficiency in designing, implementing, and maintaining data integration solutions.- Must have Familiarity with AWS integration services and tools.- Must have basic Python programming experience.- Must have...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Huntsmen & Barons Full time

    Role : Data Engineer - Spark/Scala. Job Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark, HBase, Hive and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Emorphis Technologies Pvt. Ltd. Full time

    Job Description :- Senior Data Analyst/ engineer with Snowflake and Azure experience - 7+ Years of overall technology experience that includes at least 3+ years of software development, data engineering and architecture - Excellent understanding of business functions, KPIs and Metrics and Translate them into data analytic solutions, architecture, costing...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

  • Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations, IN DoublU Pty Ltd Full time

    Job Overview :We are seeking a skilled GCP Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible,...

  • Big Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full time

    We are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...