Senior Big data Engineer

4 weeks ago


Sany, India Relic Consultancy Services Full time
Experience: 312yearsLOCATION:REMOTEResponsibilitiesSoundknowledge in Spark architecture and distributedcomputing Proficient in Spark including RDDand Dataframes core functions troubleshooting and performancetuning. Good understanding in objectorientedconcepts and hands on experience on Scala or on java with excellentprogramming logic and technique Good infunctional programming and OOPS concept either on Scala orJava Good experience in SQL should be ableto write complex queries.Managing the teamof Associates and Senior Associates and ensuring the utilization ismaintained across the project. Able tomentor new members for onboarding to theproject. Understand the client requirementand able to design develop from scratch anddeliver AWS cloud experience would bepreferable. Design build and operationalizelarge scale enterprise data solutions and applications using one ormore of AWS data and analytics services DynamoDB RedShift KinesisLambda S3 etc. (prefered) Hands onexperience utilizing AWS Management Tools (CloudWatch CloudTrail)to proactively monitor large and complex deployments(prefered) Experience in analyzingrearchitecting and replatforming onpremise data warehouses to dataplatforms on AWS(prefered) Leading theclient calls to flag off any delays blockers escalations andcollate all the requirements. Managingproject timing client expectations and meetingdeadlines. Should have played project andteam management roles. Facilitate meetingswithin the team on regular basis. Understandbusiness requirement and analyze different approaches and plandeliverables and milestones for the project.Optimization maintenance and support ofpipelines. Strong analytical and logicalskills. Ability to comfortably tackling newchallenges andlearn
QualificationsScala/JavaSpark AWSpreferable/Anycloud SQL(Intermediate to advancedlevel)ObjectOrientedProgramming Goodknowledge on ETL/ELT processes andtools

java,spark,sql,aws


  • AVP - Data Engineer

    2 months ago


    Sany, India The BIG Advantage Full time

    This is for one of the leading NBFC Companyoperating in PAN India location.Worklocation would be KurlaMumbaiBuilding /Maintaining Data lakehouse for FSS level for different linebusinesses of theCompany.ResponsibilitiesDesign architect and develop endtoend data solutions on the AzureStack platform. Implement and optimize datapipelines ETL processes and data...


  • Sany, India Findernest Software Services Pvt Ltd Full time

    QualificationsBachelorsdegree in Computer Science or Computer Engineering from anaccredited university10 years of relevantindustry experience after completingeducation5 years of Scala and Java applicationdesign and testing experience in theindustryStrong working knowledge of FunctionalProgramming paradigm and category theory in languages like Scala...

  • Big Data

    1 month ago


    Sany, India Alp Consulting Limited Full time

    Job description Based on recruitersearch Rolesand Responsibilities : Design develop test deploy and maintain largescale datapipelines using Airflow. Collaborate withcrossfunctional teams to identify business requirements and designETL processes that meet those needs. Developcomplex SQL queries to extract insights from Snowflakedatabases. Implement data...

  • Data Engineer

    3 months ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...


  • Sany, India Starcom consulting limited Full time

    NEED A SUPER SENIOR CANDIDATEWITH ENERGY CLIENT EXPERIENCE IFPOSSIBLE Do not shareif they do not haveAzurecertifications (architect certification needed for this seniorrole)Databricks certifications ( can haveEITHER Databrick cert OR Oil and Gas Experience) One isRequiredLarge scale datamigrationsAzure synapse over manyprojectsPyspark over manyprojectsFora...


  • Sany, India People Prime Worldwide Full time

    About Company: As a leading strategic partner to companies around theworld we have leveraged technology to enable businesstransformation for more than 50 years. We address the entirebreadth of business needs from strategy and design to managingoperations. JobDescription: Title: Data Engineer Location:Pan India Experience: 6 yrs.Employment Type: Contract to...

  • Data Engineer fresher

    2 weeks ago


    Sany, India Givehit private Limited Full time

    Overview:As a DataEngineer Fresher you will play a crucial role in the organizationby supporting the design development and maintenance of datasystems. You will contribute to the efficient processing andanalysis of data ultimately enabling informed decisionmaking acrossthe organization.KeyResponsibilities:Collaborate withdata scientists and analysts to...

  • Senior Data Architect

    3 months ago


    Sany, India Geminisolutions Full time

    Senior Data ArchitectIf you have a passion for all things data aninquisitive mind to learn an eye for detail a commitment to thehighest quality of work and a desire to take on additionalresponsibilities for growth we encourage you to apply for thisposition. Immediateresponsibilities: Understand businessdomain key initiatives and quality criteria Lead...

  • Data Analyst

    1 month ago


    Sany, India Feufo Inc Full time

    KeyResponsibilities: Analyze and interpret complex datasets using Snowflake SQL and Big Query.Developimplement and maintain business intelligence solutions to supportdecisionmaking processes.Create dashboards andreports to visualize data insights.Collaboratewith crossfunctional teams to understand their data needs anddeliver actionable insights.Monitor...

  • Data Engineer EDM III

    2 months ago


    Sany, India ACCELON PREMIERE CONSULTANTS PRIVATE LIMITED Full time

    Description: Location: Bangalore (Hybrid)Shift: General Shift (IST hours) Position Overview: We are looking for a talented Data Engineerwho will play an integral role in the technical development ofcritical data tools and business workflow leveraging data fordecision making. This role involves driving sales team productivitythrough creating future state best...

  • Data Engineernbsp

    3 weeks ago


    Sany, India Alp Consulting Limited Full time

    Senior Data EngineerDuties & Responsibilities To write aneffective senior data engineer job description begin by listingdetailed duties responsibilities and expectations. We have includedsenior data engineer job description templates that you can modifyand use. Sample responsibilities for thisposition include: Collaborate acrossteams on the design and...

  • Data Science

    2 weeks ago


    Sany, India Rahul Guha Full time

    ResponsibilitiesUnderstanding business objectives and developing models that helpto achieve them along with metrics to track theirprogress. Analysing the ML algorithms thatcould be used to solve a given problem and ranking them by theirsuccess probability. Exploring andvisualizing data to gain an understanding of it then identifyingdifferences in data...


  • Sany, India Overture Rede Private Limited Full time

    Responsibilities: Overall 7 8 years ofexperience with a minimum 5 years of relevant professional workExperience. Design implement and maintain datapipelines for data ingestion processing and transformation inAzure. Work together with data analysts to understandthe needs for data and create effective data workflows.Create and maintain data storage solutions...


  • Sany, India Bytemetrics Solutions Full time

    OverviewThe DataAnalyst Analytics Trainee plays a crucial role in the organizationby contributing to the analysis of complex data sets extractingvaluable insights and translating them into actionable businessstrategies. This position offers an excellent opportunity to gainhandson experience in data analytics and develop a deepunderstanding of datadriven...


  • Sany, India Randstad India Full time

    DesiredSkills/Experience 3years of Technical Product Management Data Science or SoftwareEngineering experience preferably with a focus on data architecturebusiness intelligence relational databases or bigdatatechnology. Strong math and analyticalskills with working knowledge of SDLC data engineering datamodeling data warehousing and big data...

  • Data Science

    2 months ago


    Sany, India SPECTRAL CONSULTANTS Full time

    Responsibilities: Develop advanced algorithms that solveproblems of large dimensionality in a computationally efficient andstatistically effective manner Execute statistical anddata mining techniques (e.g. hypothesis testing machine learningand retrieval processes) on large data sets to identify trendsfigures and other relevant information Collaborate...

  • Data Engineer

    2 months ago


    Sany, India Randstad India Full time

    This role will design develop and maintainthe data processing platform on Azure. The purpose of thedata platform is to integrate data across theorganization to empower and provide business partners vendorsand customers with actionable insights. The rightcandidate will implement best practices using expertise inAzure Data Services to build a scalable secure...

  • AWS Data Engineer

    2 months ago


    Sany, India Manvision Technologies Full time

    Role Summary: Senior DataEngineer Pune/Bangalore/Chennai About theRole As a SeniorData Engineer we are looking for someone passionate about workingas part of a team to deliver highquality professional dashboardsthat have a business impact. Experience inyears: At least 5 years ofhandson experience using AWS to deliver complex data pipelines forlarge...

  • Data Engineer

    3 months ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer Azure

    2 months ago


    Sany, India TCP Corps Full time

    Required Skills Python Pyspark Azure DataFactory SQL DataModellingOverview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data...