Data Engineer II

1 month ago


Sany, India Peepal Consulting Full time

Data Engineer

Job brief

We are looking for the right individual toembrace the opportunity to tackle challenging problems and usetheir influence to drive continual improvement. You will usevarious methods to transform raw data into useful data systems. Forexample youll create algorithms and conduct statistical analysis.Overall youll strive for efficiency by aligning data systems withbusiness goals.

To succeed in this dataengineering position you should have strong analytical skills andthe ability to combine data from different sources. Data engineerskills also include familiarity with several programming languagesand knowledge of learning machine methods.

Responsibilities

Analyse and organize raw data

Build datasystems and pipelines

Evaluate business needsand objectives

Interpret trends and patterns

Conduct complex data analysis and report onresults

Prepare data for prescriptive andpredictive modelling

Build algorithms andprototypes

Combine raw information fromdifferent sources

Explore ways to enhance dataquality and reliability

Identify opportunitiesfor data acquisition

Develop analytical toolsand programs

Collaborate with data scientistsand architects on several projects

Requirements and skills

Previous experience as a data engineer or in a similarrole

GCP experience is a must forthis role

Experience withBig query GCS Dataflow and other tools and techniques used forbuilding pipeline is a must

Good hands on experience in programming languages (e.g.Java and Python)

Technicalexpertise with data models data mining and segmentationtechniques

Handsonexperience with SQL and NoSQL database design

Great numerical and analytical skills

GCP Data engineering certification is a plus


  • Data Engineer

    2 months ago


    Sany, India Randstad India Full time

    This role will design develop and maintainthe data processing platform on Azure. The purpose of thedata platform is to integrate data across theorganization to empower and provide business partners vendorsand customers with actionable insights. The rightcandidate will implement best practices using expertise inAzure Data Services to build a scalable secure...

  • Data Engineer

    3 months ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer Azure

    3 months ago


    Sany, India TCP Corps Full time

    Required Skills Python Pyspark Azure DataFactory SQL DataModellingOverview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data...

  • Data Engineer AWS2

    3 months ago


    Sany, India TCP Corps Full time

    Required Experience AWS ETL Data ModellingData Integration Data Manipulation GITHUB Azure Devops DatabrickGood to havepytestWeare seeking a highly skilled AWS Data Engineer to join our dynamicteam. As an AWS Data Engineer you will be responsible for designingbuilding and maintaining data pipelines and ETL processes on theAWS platform. In addition to your...

  • Data Engineer

    3 months ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...

  • Data Engineer

    3 months ago


    Sany, India Overture Rede Private Limited Full time

    DataEngineer. KeySkills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS Databricks DataEngineering Create and maintain optimal data pipelinearchitecture Design and develop Data Warehouse solutions Assemble large complex data sets that meet functional /nonfunctional business requirements. Identify designand implement internal...

  • Data Engineer AWS1

    3 months ago


    Sany, India TCP Corps Full time

    Contributes to community buildinginitiatives like CoECoPResponsibilities:Designand Develop Data Solutions: Architect build andoptimize data pipelines and ETL processes on AWS using serviceslike Amazon Redshift Amazon RDS AWS Glue and AWS Lambda.Collaborate with crossfunctional teams to understand datarequirements and translate them into...

  • Cloud Data Engineer

    3 months ago


    Sany, India Wizaltia Hr Solutions Full time

    Roles &ResponsibilitiesAbout:Weare a digital rst technology services rm specializing inacceleratingbusiness transformation anddelivering humancentric digitalexperiences.We have been meeting customerswherever they are in the digitallifecycleand helping them outperform theircompetition through speed andinnovation. Webrings together distinct core competencies...


  • Sany, India Starcom consulting limited Full time

    NEED A SUPER SENIOR CANDIDATEWITH ENERGY CLIENT EXPERIENCE IFPOSSIBLE Do not shareif they do not haveAzurecertifications (architect certification needed for this seniorrole)Databricks certifications ( can haveEITHER Databrick cert OR Oil and Gas Experience) One isRequiredLarge scale datamigrationsAzure synapse over manyprojectsPyspark over manyprojectsFora...

  • AVP - Data Engineer

    2 months ago


    Sany, India The BIG Advantage Full time

    This is for one of the leading NBFC Companyoperating in PAN India location.Worklocation would be KurlaMumbaiBuilding /Maintaining Data lakehouse for FSS level for different linebusinesses of theCompany.ResponsibilitiesDesign architect and develop endtoend data solutions on the AzureStack platform. Implement and optimize datapipelines ETL processes and data...


  • Sany, India People Prime Worldwide Full time

    About Company: As a leading strategic partner to companies around theworld we have leveraged technology to enable businesstransformation for more than 50 years. We address the entirebreadth of business needs from strategy and design to managingoperations. JobDescription: Title: Data Engineer Location:Pan India Experience: 6 yrs.Employment Type: Contract to...


  • Sany, India Taurus Contractors Pvt Ltd Full time

    Job Summary: Must have over 10years of relevant work experience out of which 6 must be as a LeadEngineer in the Oil and Gas industry. Must have softwareskills specifically in CAESER II/ROHR. Experience inDesign StressStrain Analysis Calculations and Piping StressAnalysis is required. Must be skilled in their owndiscipline. Must have a firm grasp of Project...


  • Sany, India Risk Resources LLP Full time

    Hiwe arehiring for Data EngineerSnowflake.Skills: Data Engineer Snowflake / Azure (ADLS ADF Synapse)/AWS (Redshift EMRGlue)/Informatica/DataStageLocation: Pan indiaExperience:6 8yearsDesigning and developingdata models and data warehouses usingSnowflakeCreating and maintaining databaseobjects such as tables views stored procedures functions...

  • Backend Data Engineer

    3 weeks ago


    Sany, India ConsultBae India Private limited Full time

    BranchOverviewImagine a world whereevery person has improved access to financial services. Peoplecould start new businesses pay for their children s education covertheir emergency medical bills the possibilities to improve life areendless. Branch is a global technologycompany revolutionizing financial access for millions ofunderserved banking customers today...

  • AWS Data Engineer

    3 months ago


    Sany, India Manvision Technologies Full time

    Role Summary: Senior DataEngineer Pune/Bangalore/Chennai About theRole As a SeniorData Engineer we are looking for someone passionate about workingas part of a team to deliver highquality professional dashboardsthat have a business impact. Experience inyears: At least 5 years ofhandson experience using AWS to deliver complex data pipelines forlarge...

  • Data Engineer

    3 months ago


    Sany, India Informica Full time

    Job DescriptionExperience Required: 48 yrs.Knowledge on Data Modelling Data warehouse andData Analysis is also required.Immediate requirement: 1520 days joineronly. Data EngineerKey Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline architecture ...

  • Data Engineer EDM III

    2 months ago


    Sany, India ACCELON PREMIERE CONSULTANTS PRIVATE LIMITED Full time

    Description: Location: Bangalore (Hybrid)Shift: General Shift (IST hours) Position Overview: We are looking for a talented Data Engineerwho will play an integral role in the technical development ofcritical data tools and business workflow leveraging data fordecision making. This role involves driving sales team productivitythrough creating future state best...

  • Data Engineer

    3 weeks ago


    Sany, India Alp Consulting Limited Full time

    ood Communication & presentationskills. Strong Knowledge of Azure ComponentsAzure Data Lake Azure Data Factory Azure SQL AzureDatabricks Must have strong knowledge &hands on in Apache Spark and Scala / Python programming workingwith Delta Tables & Databricks. Strong SQLSkills: Data modeling Developing SQL Store Procedures FunctionsDynamic SQL queries...

  • Manager IT

    2 months ago


    Sany, India SPECTRAL CONSULTANTS Full time

    We are looking for an experienced Cloud andData Manager to provide strategic and technical direction to helpdeliver our nextgeneration solutions using cloudbased technologies.This role requires expertise around data quality and maintainingthe production environment where the delivered solutions areexecuting on daily basis. You must be an excellent...


  • Sany, India Yujji Full time

    Overview:The Full TimeLecturer for Data Engineering and AI/ML plays a crucial role in theorganization by imparting knowledge and skills in the dynamicfields of data engineering artificial intelligence and machinelearning. This role is integral in shaping the next generation ofdata scientists and engineers and contributing to the growth ofAI/ML...