Data Engineer

4 weeks ago

sany, India Informica Full time

Data EngineerTide

Experience5 to 8 Years

Number of Position(s) 5

MandatorySkills

SQL Distributed ETLData Pipeline Building Data modeling Snowflake

JobDescription

LocationGurgram/Bangalore

MANDATORY SKILLSET Team Management SQL ExpertDistributed ETL Data Pipeline Building Data Modeling KPIs Knowledgeof Snowflake

As part of theteam you will be responsible for building and running the datapipelines and services that are required to support businessfunctions/reports/dashboard. We are heavily dependent onBigQuery/Snowflake Airflow Stitch/Fivetran dbt Tableau/Looker forour business intelligence and embrace AWS with someGCP.

As a Data Engineer youllbe:

  • Developing end to end ETL/ELT Pipeline workingwith Data Analysts of business Function.

  • Designing developing andimplementing scalable automated processes for data extractionprocessing and analysis in a Data Mesharchitecture.

  • Mentoring Fother Junior Engineers in theTeam

  • Be a goto expert for data technologies andsolutions

  • Ability to provide on the ground troubleshootingand diagnosis to architecture and designchallenges

  • Troubleshooting and resolving technical issues asthey arise

  • Looking for ways of improving both what and howdata pipelines are delivered by the department

  • Translating businessrequirements into technical requirements such as entities that needto be modelled DBT models that need to be build timings tests andreports

  • Owning the delivery of data models and reportsend to end

  • Perform exploratory data analysis in order toidentify data quality issues early in the process and implementtests to ensure prevent them in the future

  • Working with Data Analyststo ensure that all data feeds are optimised and available at therequired times. This can include Change Capture Change Data Controland other delta loading approaches

  • Discovering transforming testingdeploying and documenting data sources

  • Applying help defining andchampioning data warehouse governance: data quality testing codingbest practises and peer review

  • Building Looker Dashboard for usecases if required

QUALIFICATIONS

  • Having 5 years of extensivedevelopment experience using snowflake or similar data warehousetechnology

  • Having working experience with dbt and othertechnologies of the modern data stack such as Snowflake ApacheAirflow Five Tran AWS git Looker

  • Experience in agile processes such asSCRUM

  • Extensive experience in writing advanced SQLstatements and performance tuning them

  • Experience in DataIngestion techniques using custom or SAAS tool likefivetran

  • Experience in data modelling and can optimiseexisting/new data models

  • Experience in data mining data warehousesolutions and ETL and using databases in a business environmentwith largescale complex datasets

RequiredQualification

Bachelor ofComputer Science (B.Sc. (Computer Science))

  • Data Engineer

    2 months ago

    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    2 weeks ago

    sany, India Informica Full time

    Job Description Experience Required: 48 yrs. Knowledge on Data Modelling Data warehouse andData Analysis is also required. Immediate requirement: 1520 days joineronly. Data Engineer Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline...

  • Data Engineer

    2 weeks ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • Data Engineer

    2 weeks ago

    Sany, India Bitcoin Devs Company Full time

    Overview:TheData Engineer Lead plays a crucial role in our organization workingremotely to design develop and maintain scalable data pipelines andinfrastructures for our data platforms. This position is vital inensuring the efficiency reliability and quality of our datasolutions enabling our teams to make informed decisions and drivebusinessgrowth.TheData...

  • Data engineer

    2 weeks ago

    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    2 days ago

    sany, India Randstad India Full time

    This role will design develop and maintainthe data processing platform on Azure. The purpose of thedataplatform is to integrate data across theorganization to empower and provide business partners vendorsandcustomers with actionable insights. The rightcandidate will implement best practices using expertise inAzureData Services to build a scalable secure...

  • Data Engineer

    3 months ago

    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 weeks ago

    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 weeks ago

    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    2 weeks ago

    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    2 weeks ago

    sany, India Informica Full time

    Data EngineerTide Experience5 to 8 Years Number of Position(s) 5 MandatorySkills SQL Distributed ETLData Pipeline Building Data modeling Snowflake JobDescription LocationGurgram/Bangalore MANDATORY SKILLSET Team Management SQL ExpertDistributed ETL Data Pipeline Building Data Modeling KPIs Knowledgeof Snowflake As part of theteam you will be...

  • Data Engineer Azure

    4 days ago

    Sany, India TCP Corps Full time

    Required Skills Python Pyspark Azure DataFactory SQL DataModellingOverview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data...

  • Snowflake Data Engineer

    2 weeks ago

    sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes Data Engineer Location: India (Remote Work) Minimum Qualification: Bachelor's degree or higher in the technology field Experience: 3+ years Domain: US Healthcare Customer Profile: Captive research and development pods for a 500-million-member group of pharma data research companies that assist patients in accessing life-saving...

  • Data Engineer AWS2

    6 days ago

    Sany, India TCP Corps Full time

    Required Experience AWS ETL Data ModellingData Integration Data Manipulation GITHUB Azure Devops DatabrickGood to havepytestWeare seeking a highly skilled AWS Data Engineer to join our dynamicteam. As an AWS Data Engineer you will be responsible for designingbuilding and maintaining data pipelines and ETL processes on theAWS platform. In addition to your...

  • Data Engineer

    4 weeks ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...

  • Data Engineer with Datastage

    2 weeks ago

    sany, India eTek IT Services, Inc. Full time

    Role : DataEngineer Location: CincinnatiOhio Experience:5years W2Contract JobDescriptionJobOverview: Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow...

  • Python Data Engineer

    4 weeks ago

    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...

  • Python Data Engineer

    6 days ago

    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...

  • Data Engineer

    7 days ago

    Sany, India Overture Rede Private Limited Full time

    DataEngineer. KeySkills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS Databricks DataEngineering Create and maintain optimal data pipelinearchitecture Design and develop Data Warehouse solutions Assemble large complex data sets that meet functional /nonfunctional business requirements. Identify designand implement internal...

  • Data Engineer

    2 days ago

    sany, India Overture Rede Private Limited Full time

    DataEngineer .KeySkills :Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS Databricks DataEngineeringCreate and maintain optimal data pipelinearchitectureDesign and develop Data Warehouse solutionsAssemble large complex data sets that meet functional /nonfunctional business requirements.Identify designand implement internal process...