Data Engineer Developer

4 weeks ago


Sany, India CGVAK Software AND Exports Limited Full time
Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:
  • Designing andimplementing robust ETL processes using Databricks andSpark
  • Developing and optimizing data pipelinesfor largescale data processing
  • Collaboratingwith data engineers and data scientists to support their datainfrastructure needs
  • Building and maintainingdata warehouse solutions to support businessanalytics
  • Performing data modeling andoptimization to ensure efficient data storage andretrieval
  • Troubleshooting and resolvingperformance issues with data infrastructure andpipelines
  • Implementing security and datagovernance best practices within the dataplatform
  • Automating data quality checks andensuring data consistency andaccuracy
  • Collaborating with crossfunctionalteams to understand data requirements and deliversolutions
  • Monitoring and maintaining the healthof data pipelines andinfrastructure
  • Documenting technical design andarchitecture of data solutions
  • Participating incode reviews and providing constructive feedback topeers
  • Staying updated with the latestadvancements in Databricks and Sparktechnologies
  • Providing technical guidance andmentorship to junior teammembers
RequiredQualifications:
  • Bachelors degree inComputer Science Engineering or a relatedfield
  • Proven experience in developing datapipelines using Databricks andSpark
  • Proficiency in ETL processes and datawarehousing concepts
  • Strong SQL skills with theability to write complex queries for data manipulation andanalysis
  • Advanced programming skills in Pythonfor data processing and manipulation
  • Experiencein data modeling and optimizing data storage forperformance
  • Deep understanding of big datatechnologies and distributed computingconcepts
  • Ability to troubleshoot and optimizedata pipeline performance for efficiency andreliability
  • Knowledge of data governancesecurity and compliance bestpractices
  • Excellent communication andcollaboration skills to work effectively in a teamenvironment
  • Strong analytical andproblemsolving abilities to tackle complex data engineeringchallenges
  • Ability to multitask and prioritizetasks in a fastpaced and dynamic workenvironment
  • Experience with cloud platformssuch as AWS Azure or GCP is aplus
  • Certifications in Databricks andSparkrelated technologies aredesirable
  • Experience in Agile developmentmethodologies and version controlsystems

ExperienceRequired:Data Engineeringresource with Databricks (Databricks develops a webbased platformfor working with Spark) experience with Python coding background& SQL

data,spark,datagovernance,data modeling,python,brick


  • Data Engineer

    4 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    4 weeks ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data engineer

    5 days ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data engineer

    2 weeks ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    4 weeks ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    1 week ago


    sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...


  • sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...

  • Data Engineer

    3 weeks ago


    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...

  • Data Engineer

    4 weeks ago


    Sany, India Bista Univarsal Limited Full time

    Overview:The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities:Design andimplement scalable data...

  • Azure Data Engineer

    3 weeks ago


    sany, India Zerozilla Full time

    No. of Position: 2 Position: Azure Data Engineer Exp: 58Years Location: Bangalore Hybrid NP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling &...

  • Azure Data Engineer

    4 weeks ago


    Sany, India Zerozilla Full time

    No. of Position: 2Position: Azure Data Engineer Exp: 58Years Location: Bangalore HybridNP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling & Thereis an...


  • Sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...

  • AWS Data Engineer

    1 week ago


    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • Azure Data Engineer

    7 days ago


    sany, India SAM Manpower and Career Services LLP Full time

    Azure Data Engineer with DataVisualization Expert JobDescription JobSummary: We are seeking a skilledSenior Data Engineer with expertise in data visualizationparticularly in Azure Databricks Synapse Power BI and Tableau. Theideal candidate will play a crucial role in designing andoptimizing data architecture implementing ETL processes andcreating...


  • Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...


  • sany, India Talentxo Full time

    About theCompany: We are hiring for amidsized technology company focused on improving recruitmentprocesses through innovative technology solutions. Their mission isto empower recruiters with the tools and resources they need tofind and hire top talentefficiently.JobDescription: We are seeking aSenior/Staff Data Warehouse Engineer Data Engineering to join...

  • Data Engineer

    4 hours ago


    sany, India Agilite Global Solutions Company Full time

    Role: DataEngineer Location: India Remote Work from Anywhere inIndiaMinimum Qualification: B. Tech. or equivalent from an accreditedinstitutionIndicativeExperience: 6YearsDomain: USHealthCare.Customer Profile: Captive research and development pods for a 500millionmember group of pharma data research companies that helppatients gain access to lifesaving...

  • GCP Data Engineer

    3 weeks ago


    Sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...

  • GCP Data Engineer

    1 week ago


    sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...


  • sany, India Randstad India Full time

    Description: Data Migration EngineerRole andResponsibilities:Work with the customer userstechnical architect and application designers to define the datamigration requirements and structure for theapplication.Lead the data migration plan analysisdesign and build effort.Work with the technicalarchitects and application designers to understand the...