Data Engineer

2 months ago

Anywhere in IndiaMultiple Locations, IN Risk Resources LLP Full time

Overview :

The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and unstructured data.

Key Responsibilities :

- Design and develop data pipelines using Snowflake, Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.

- Implement, maintain, and optimize data infrastructure on AWS, including Redshift, EMR, and Glue.

- Collaborate with data scientists and analysts to understand data requirements and implement the necessary data transformations and integrations.

- Ensure data quality and reliability by designing and implementing data cleansing and validation processes.

- Develop and maintain ETL processes using Informatica and DataStage to extract, transform, and load data from various sources.

- Optimize query performance and data distribution on Snowflake to ensure efficient data access and processing.

- Implement best practices for data security, encryption, and access control on Azure and AWS platforms.

- Participate in the evaluation and selection of new data management and analytics technologies to meet evolving business needs.

- Document data architecture, data flows, and data processes to facilitate knowledge sharing and collaboration.

- Provide technical guidance and support to junior data engineering team members.

Required Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience in designing and implementing data solutions on Snowflake, Azure, and AWS platforms.

- Expertise in using Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics for data management and analytics.

- Demonstrated proficiency in working with AWS Redshift, EMR, and Glue for data warehousing and ETL processes.

- Strong understanding of data integration and transformation using Informatica and DataStage.

- In-depth knowledge of SQL and programming languages such as Python or Java for data manipulation and automation.

- Experience in optimizing Snowflake data warehouse performance and scalability.

- Familiarity with data modeling, schema design, and data governance best practices.

- Ability to collaborate effectively with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.

- Strong problem-solving skills and the ability to troubleshoot and optimize complex data pipelines.

- Experience with version control systems and continuous integration/continuous deployment (CI/CD) processes for data engineering projects.

- Certifications in relevant cloud platforms (e.g., Microsoft Azure, Amazon Web Services) and data engineering tools.

- Excellent written and verbal communication skills.

- Ability to adapt to new technologies and learn continuously in a fast-paced, dynamic environment.

(ref:hirist.tech)

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full time

    Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full time

    We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer,Mandatory Skills :- Databricks(PySpark, Scala)- Data Factory/Synapse- SQL DB and DW- Working knowledge on Git Roles and Responsibilities :Requirements :- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.- Good...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Vysystems Full time

    Data Engineer Need short joinersJob Location : Bangalore - Manyata Tech ParkMode : Hybrid.Experience : 4-8 yearsJob Description : We are looking for a skilled Data Engineer with expertise in Azure Data Factory, Azure Databricks, PySpark, Snowflake, and SQL. The ideal candidate will play a key role in designing, building, and maintaining scalable data...

  • Data Quality Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job Summary :We are seeking a detail-oriented and analytical Data Quality Engineer to join our team. The ideal candidate will be responsible for ensuring the accuracy, integrity, and reliability of our data across various systems. You will work closely with data engineers, data scientists, and other stakeholders to implement data quality processes and...

  • DevOps & Data Engineer

    6 months ago

    Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Machine Minds Full time

    Job Description : Data EngineerThe Position : We are seeking an experienced Data Engineer to join our team of passionate professionals working on cutting-edge technology. In this role, you will be responsible for the ELT of Canibuild data using Python, Airflow, and SQL within an AWS environment. Additionally, you will create and maintain data visualizations...

  • Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations, IN Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN MindBrain Full time

    Job Title : Data Engineer. Location : Remote. Experience : 6+ Years. Contract : 6 Months (Extendable). Skills Required : - Python : Extensive experience in Python for advanced data manipulation, automation, and scripting. - SQL : Expertise in SQL for complex querying, database management, and performance optimization. - Databricks : Proficient in using...

  • Lead Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    Job Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...

  • Technical Lead

    2 months ago

    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job Summary :We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, and ensuring data integrity, security, and performance. Oversee technical aspects of data integration and...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Apidel Technologies Full time

    Data Engineer | 100% Remote | 12-Month Contract. We are looking for an experienced Data Engineer to join our team on a 12-month remote contract. This role offers a great opportunity to work with Azure services, including Azure Databricks, Azure DataFactory, and Azure DevOps, to build secure, scalable data pipelines. What You'll Do :- Develop data...

  • Lead Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Talentoj Full time

    Requirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write unit tests...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN TalenTECH Solutions Private Limited Full time

    Technical/Functional Skills :Must have :- 5+ years of experience working in data warehousing systems- Strong experience in Oracle Fusion ecosystem, with strong data-extracting experience using Oracle BICC/BIP.- Must have good functional understanding of Fusion data structures.- Must have strong and proven data engineering experience in big data / Databricks...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Huntsmen & Barons Full time

    Role : Data Engineer - Spark/Scala. Job Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark, HBase, Hive and...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Emorphis Technologies Pvt. Ltd. Full time

    Job Description :- Senior Data Analyst/ engineer with Snowflake and Azure experience - 7+ Years of overall technology experience that includes at least 3+ years of software development, data engineering and architecture - Excellent understanding of business functions, KPIs and Metrics and Translate them into data analytic solutions, architecture, costing...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN DoublU Pty Ltd Full time

    Job Overview :We are seeking a skilled GCP Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible,...

  • Big Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full time

    We are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...

  • Python Developer

    2 months ago

    Anywhere in India/Multiple Locations, IN Red Oak Technologies Full time

    Red Oak Technologies is a leading provider of comprehensive resourcing solutions across a variety of industries and sectors including IT, Marketing, Finance, Business Operations, Manufacturing and Engineering. We specialize in quickly acquiring and efficiently matching top-tier professional talent with clients in immediate need of highly skilled contract,...

  • Java Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Hum Technologies Full time

    Job Description : We are hiring for Sr. Java Data Engineer with strong Exp. in Java, Spring, Restful-API, Microservices, AWS / AZURE, SQL, Data Structures, Algorithms, Multithreading, Hashmaps, Arrays.Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : Remote/ HybridRole : Java Data Engineer.Must-Have :- 4+ years of experience...