Data Engineer

4 weeks ago


PuneMP, IN Deqode Full time

Job Description :

  • Design and implement data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub
  • Develop and maintain data ingestion and transformation processes using tools like Apache Beam and Apache Spark
  • Create and manage data storage solutions using GCP services such as BigQuery, Cloud Storage, and Cloud SQL
  • Build and deploy machine learning models using GCP's AI Platform and TensorFlow
  • Implement data security and access controls using GCP's Identity and Access Management (IAM) and Cloud Security Command Center
  • Monitor and troubleshoot data pipelines and storage solutions using GCP's Stackdriver and Cloud Monitoring
  • Collaborate with data scientists and analysts to understand their data requirements and provide solutions to meet their needs
  • Automate data processing tasks using scripting languages such as Python and Bash
  • Participate in code reviews and contribute to the development of best practice for data engineering on GCP
  • Stay up-to-date with the latest GCP services and features and evaluate

(ref:hirist.tech)
  • Data Scientist

    4 weeks ago


    MP, IN Golden Fox Full time

    Job Title : Data Science EngineerExperience : 3-4 yearsLocation : IndoreJob Description :We are seeking a highly skilled and experienced Data Science Engineer to join our dynamic team. The ideal candidate will have a strong background in data science, machine learning, and a deep understanding of Python web frameworks, along with expertise in cloud platforms...


  • Pune/Mysore, IN IT Full time

    We are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library. The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions. Additionally, experience with Azure...

  • Data Engineer

    6 days ago


    Nagpur/Pune, IN SPN Globe Full time

    Job Description :Mandatory Skills : Azure Data Engineer, ADF, Synapse, Databricks, Azure DevOps, Data lake, SQL, and Responsibilities :Designing and implementing data storage solutions on AzureBuilding and maintaining data pipelines for data integration and processingEnsuring data quality and accuracy through testing and validationOptimizing data processing...

  • AWS Data Engineer

    7 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • Data Engineer

    4 weeks ago


    Hyderabad/Pune/Ahmedabad, IN Talentoj Full time

    Azure Data Engineer :We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required.The ideal candidate should have extensive experience in Python programming and be proficient in...

  • Python Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN Promaynaov Advisory Services Pvt Ltd Full time

    Role : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process - Software design, Scala & Spark development,...

  • Data Engineer

    4 days ago


    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Azure DevOps Engineer

    4 weeks ago


    MP/Pune, IN Deqode Full time

    Key Responsibilities :Designing and implementing secure cloud infrastructure using Azure services to support scalable and reliable software deploymentAutomating and optimizing continuous integration and continuous delivery (CI/CD) pipelines for system provisioning and application deploymentManaging source code repositories and branching strategies to...

  • Django Developer

    4 weeks ago


    MP, IN RubyPy Full time

    PYTHON DEVELOPERJob Description :Designation : Python DeveloperLocation : Indore | OnsiteExperience : 2-5 yearsSkills : Python, Django, Flask, Numpy, Panda, RESTful APIs.Python Developer Responsibilities :1. Coordinating with development teams to determine application requirements.2. Writing scalable code using Python programming language.3. Testing and...

  • PHP Developer

    3 days ago


    MP, IN Hitya Global Full time

    Job Description :Client is looking for a PHP Developer responsible for managing back-end services and the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the...

  • JS Tech Alliance

    4 weeks ago


    MP, IN JS Tech Alliance Full time

    A Flutter developer is someone who specializes in using the Flutter framework, which is an open-source UI software development kit (SDK) created by Google. Flutter developers are typically skilled in programming languages like Dart, as Dart is the language used to write Flutter apps. They are responsible for designing, developing, testing, and maintaining...

  • Data Engineer

    4 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Data Engineer

    4 weeks ago


    Bangalore/Pune, IN vipsa solutions Full time

    SALARY : 15LPA - Engineer:Location: Pune, BangaloreExperience: 6-9 yearsNP: Immediate- 15 daysKey accountabilities:As a Data Engineer you will be accountable for:- Understanding operational needs by collaborating with specialized teams- Supporting key, involves architecture designing, building and deploying data systems, pipelines etc- Build agile, scalable,...

  • Data Engineer

    4 weeks ago


    Bangalore/Pune, IN Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Data Engineer

    4 weeks ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...


  • Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full time

    Required Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • Cloud Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Chennai/Pune/Anywhere in India/Multiple Locations, IN Amk technologies Full time

    Job Description :We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team.As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration across...

  • Azure Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Data Engineer

    2 weeks ago


    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Mumbai/Ahmedabad, IN Sterlite Technologies Limited Full time

    Role as a Data engineer :- Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake- Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability.- Partner with AI/ML product teams proactively identify the data needs for rapid experimentation, stable production deployment and ensure the...