Databricks Data Engineer

4 weeks ago


Sany, India BigShyft Full time
AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.
JobDescription:As a DatabricksData Engineer you will be responsible for designing implementingand improving processes and automation within our datainfrastructure. You will play a crucial role in ensuring thereliability performance and scalability of our data pipelines. Yourresponsibilities willinclude:
  • Designing implementing andimproving processes & automation of Datainfrastructure.
  • Tuning Data pipelines forreliability & performance.
  • Buildingtools and scripts to develop monitor and troubleshoot ETLprocesses.
  • Performing scalability latency andavailability tests regularly.
  • Conducting codereviews and QA of data imported by variousprocesses.
  • Investigating analyzing correctingand documenting reported data defects.
  • Creatingand maintaining technical specificationdocumentation.

Whatmakes you a greatfit:
  • B.Tech./BSdegree in Computer Science Computer Engineering Statistics or otherrelevant Engineering disciplines.
  • Minimum 4years of professional work experience with at least 2 years ofhandson experience with Databricks.
  • Highlyproficient in SQL & Data model (conceptual and logical)concepts.
  • Proficiency with Python &Spark (1 year).
  • Knowledge of Distributedcomputing and cloud databases like Redshift BigQueryetc.
  • 1 years of handson experience with one ofthe top cloud platformsAWS/GCP/Azure.
  • Experience with Modern Datastack tools like Airflow Terraform DBT Glue Dataprocetc.
  • Exposure to Hadoop & Shellscripting is aplus.

WhyJoin Us:
  • Opportunityto work with cuttingedge technologies and shape the future of datainfrastructure.
  • Collaborative and dynamic workenvironment where your ideas arevalued.
  • Competitive salary and benefitspackage.
  • Room for growth and advancement withinthe company.

sql,datamodeling,python,spark,distributed computing,cloud databases,amazonredshift,gcp,aws,azure,airflow,terraform,dbt,glue,dataprocessing,hadoop,shell scripting,data engineering,datainfrastructure



  • sany, India Findernest Software Services Pvt Ltd Full time

    Overview: TheDatabricks Cloud Architect plays a crucial role in designingimplementing and maintaining Databricks cloud solutions. They areresponsible for overseeing the architecture development anddeployment of Databricksbased data solutions to meet theorganizations needs.KeyResponsibilities: Design andimplement Databricks cloud solutions to meet...


  • Sany, India CGVAK Software AND Exports Limited Full time

    Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:Designing andimplementing robust ETL...


  • sany, India IndiSquad Full time

    JobDescription:One ofour client is seeking a talented and experienced Azure DatabricksAdmin and Developertojoin our team inYadwada Pune. The ideal candidate will have extensive experience inadministeringanddevelopingsolutions using Azure Databricks along with a strong understandingof cloud technologiesanddata...

  • Data engineer

    5 days ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data engineer

    2 weeks ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data bricks Admin

    4 weeks ago


    sany, India TalentPulse Consultant Full time

    Responsibilities: Installconfigure and maintain Databricks environments to support dataengineering and analyticsactivities.Collaboratewith crossfunctional teams to understand data requirements andoptimize Databricks clustersaccordingly.MonitorDatabricks performance troubleshoot issues and implement solutionsto ensure systemreliability.Implementsecurity...

  • Data bricks Admin

    2 weeks ago


    Sany, India TalentPulse Consultant Full time

    Responsibilities:Installconfigure and maintain Databricks environments to support dataengineering and analyticsactivities.Collaboratewith crossfunctional teams to understand data requirements andoptimize Databricks clustersaccordingly.MonitorDatabricks performance troubleshoot issues and implement solutionsto ensure systemreliability.Implementsecurity...

  • Azure Data Engineer

    7 days ago


    sany, India SAM Manpower and Career Services LLP Full time

    Azure Data Engineer with DataVisualization Expert JobDescription JobSummary: We are seeking a skilledSenior Data Engineer with expertise in data visualizationparticularly in Azure Databricks Synapse Power BI and Tableau. Theideal candidate will play a crucial role in designing andoptimizing data architecture implementing ETL processes andcreating...


  • sany, India RipplesIndia Group Full time

    Head Enterprise Data & JobSummary : The Head of Data & Insights willbe responsible for leading the development and implementation ofdatadriven strategies data engineering reporting analytics and Datascience solutions using Azure Databricks PowerBI and othertoolsets. This role requires a strong understanding of dataanalytics data engineering and data...

  • Azure Data Engineer

    3 weeks ago


    sany, India Zerozilla Full time

    No. of Position: 2 Position: Azure Data Engineer Exp: 58Years Location: Bangalore Hybrid NP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling &...

  • Azure Data Engineer

    4 weeks ago


    Sany, India Zerozilla Full time

    No. of Position: 2Position: Azure Data Engineer Exp: 58Years Location: Bangalore HybridNP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling & Thereis an...


  • sany, India TalentBasket Full time

    KeyResponsibilities: Designthe overall architecture and framework for data solutions andintegration. Collaborate with stakeholders tounderstand requirements and translate them into technicaldesigns. Provide technical guidance to theteam ensuring alignment with best practices. Oversee the implementation and integration of datasystems and processes. ...

  • Sr Data Engineer

    4 weeks ago


    Sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideasShould be aware for Agile Mode of...

  • Sr Data Engineer

    5 days ago


    sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideas Should be aware for Agile Mode...

  • Data Engineer

    4 weeks ago


    Sany, India TalentOla Full time

    SKILLS Soft skills Combination of business focus analyticaland problem solving skills in order to quickly define a datadriven solution within differentinitiatives Ability to work within a teamand with a proactive attitude Ability tocommunicate and popularize technical topics Tech skills Main skills Strong programming skills in Python andSQL Strong...

  • Quality Engineer

    7 days ago


    sany, India TalentOla Full time

    JD is as follows: 8years of experience. Python Pyspark automation with Databricks andAzure strong sql expertise JD is as follows: 6 years of experience. Python Pysparkautomation with Databricks and Azure strong sql expertisePowerBI JD is as follows: 6years of experience. Performance test experience using JMeterSelenium Power BI in Big data...


  • sany, India SAM Manpower and Career Services LLP Full time

    Role: Data Engineer/ETLDeveloperExperience: 6YearsLocation: PANIndiaNotice:Immediate joinersonlyResponsibilities:Developsand maintains scalable data pipelines for extraction transformationand loading of data from various data sources using ETLtools. Collaborates with product owners tobuild data models that feed business intelligencetools. Building analytical...

  • Data Engineer

    4 weeks ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    1 week ago


    sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    4 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...