See more Collapse

Adb + Pyspark + SQL

2 months ago

Bengaluru, India RARR Technologies Full time

**Job Details - ADB + Pyspark + SQL**:
**Job ID**:

- RARR Job 3323**Job Title**:

- ADB + Pyspark + SQL**Job Type**:

- Permanent**Job Location**:

- Bangalore**Total Experience**:

- 5 - 8 Years**Skills**:

- Adb, Sql, Pyspark, Azure Databricks, Synapse Analytics**Posted - **23/05/2023

**Job Description**:
**Responsibilities**:

- Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF).
- Write efficient and optimized PySpark code to process and transform large datasets.
- Develop and maintain SQL scripts and queries for data extraction, transformation, and loading (ETL) processes.
- Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.
- Ensure data quality and integrity throughout the data pipelines and systems.
- Optimize data storage, processing, and retrieval on the Azure platform.
- Monitor and troubleshoot data pipelines to identify and resolve issues.
- Perform data analysis and provide insights to support business decision-making.
- Stay updated with the latest trends and technologies in data engineering and recommend improvements to existing systems.

We have other current jobs related to this field that you can find below

  • Adb + Pyspark + SQL(Rarr Job 3323)

    2 weeks ago

    Bengaluru, India RARR Technologies Pvt Ltd Full time

    For LTIMINDTREE - 5 - 8 Years- Full Time- BANGALORE/BENGALURU**Job Skills**: SQL ADB PYSPARK AZURE DATABRICKS SYNAPSE ANALYTICS **Responsibilities**: - Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF). - Write efficient and optimized PySpark code to process and transform large datasets. - Develop and...

  • Azure Data Bricks 6 to 9 Years Pan India

    2 months ago

    Bengaluru, India Capgemini Full time

    Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/Pyspark/Scala/Hive Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skill**: - ADB (Azure Data...

  • Pyspark, Python, SQL

    1 week ago

    Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...

  • azure data bricks

    5 days ago

    Bengaluru, Karnataka, India Growel Softech Ltd Full time

    Job Description 4+years experience Mandatory• Experience with Azure Data Bricks, Data Factory • Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics • Experience in Python/ Pyspark Programming. • Experience with Azure Databricks/ADB • Experience with building CI/CD pipelines in Data environments...

  • Azure Data Bricks 6 to 9 Years Pan India

    2 months ago

    Bengaluru, India Capgemini Full time

    Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/Pyspark/Scala/Hive Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills** - ADB (Azure Data Bricks)...

  • Azure Data Engineer

    5 days ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India Fixity Technologies LLC Full time

    Location : Pan IndiaExperience : 5 to 14 YearsNeed candidates who are serving notice periodTechnical Stack - AZURE Data Factory, Azure Data Bricks, Data Lake, Pyspark, SQL ,ADF, ADB, ADL

  • azure data bricks

    5 days ago

    Bengaluru, Karnataka, India Growel Softech Ltd Full time

    Job Description:4+years experience MandatoryExperience with Azure Data Components:Azure Data DatabricksData FactoryAzure SQL DatabaseAzure SQL WarehouseSYNAPSE AnalyticsExperience in Python/ Pyspark ProgrammingExperience with building CI/CD pipelines in Data environments Primary Skills:Azure Data Databricks (ADB)Python, Apache Pyspark, ScalaAzure SQLAzure...

  • Data Engineer | Python| Pyspark| Airflow| SQL

    1 month ago

    Bengaluru, India Michael Page Full time

    Competetive SalaryPF and GratuityAbout Our ClientOur client is an international professional services brand of firms, operating as partnerships under the brand. It is the second-largest professional services network in the world.Job DescriptionJD -Strong proficiency in Python programmingExperience working with complex SQL queriesGood with PySpark,...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Alp Consulting Limited Full time

    Responsibilities:As an Azure Data Engineer, your day-to-day work activities will be as follows:Design & develop the ETLCreate the Pipelines (simple and complex) using ADF.Work with other Azure stack modules like Azure Data Lakes, SQL DWMust be extremely well versed with handling large volumes of dataUnderstand the business requirements for Data flow process...

  • Data Engineer

    2 months ago

    Bengaluru, India Recro Full time

    Requirements: Min. 5 years of experience with python and Java data engineeringExperience in Developing Data Pipelines using Python, PySpark, Pandas etc, on AWS/AzureStrong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)Experience in developing ETL, OLAP based and Analytical Applications.Experience in ingesting batch...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Recro Full time

    Requirements: Min. 5 years of experience with python and Java data engineeringExperience in Developing Data Pipelines using Python, PySpark, Pandas etc, on AWS/AzureStrong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)Experience in developing ETL, OLAP based and Analytical Applications.Experience in ingesting batch...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Recro Full time

    Requirements: Min. 5 years of experience with python and Java data engineeringExperience in Developing Data Pipelines using Python, PySpark, Pandas etc, on AWS/AzureStrong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)Experience in developing ETL, OLAP based and Analytical Applications.Experience in ingesting batch...

  • Pyspark ,SQL & Bigdata Hive

    3 days ago

    Bengaluru, India Integrated Personnel Services Private Limited Full time

    Job Description - About Us - Integrated Personnel Services Ltd. (IPSL) incorporated in the year 2004, with intent to deliver integrated solutions for Recruitment, HR Management / processing and HR outsourcing for IT and Non-IT companies that exactly matching to the client’s requirements. IPS Groups customer centric orientation in providing complete HR...

  • Bigdata + Pyspark

    5 days ago

    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark :Big Data; Hadoop / HDFS,Pyspark,PythonExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software developmentProficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...

  • Python, Pyspark

    5 days ago

    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

  • Senior Solution Architect

    2 months ago

    Bengaluru, India Merck Group Full time

    Role : Senior Solution Architect About the Role: As a Solutions Architect at our dynamic tech firm, you will play a pivotal role in shaping the architectural vision and strategy for our clients. You'll leverage your hybrid skills as both an architect and a software developer to design and implement robust, scalable, and efficient solutions. You lead the...

  • Senior Solution Architect

    3 weeks ago

    Bengaluru, India Merck Group Full time

    Role : Senior Solution Architect About the Role: As a Solutions Architect at our dynamic tech firm, you will play a pivotal role in shaping the architectural vision and strategy for our clients. You'll leverage your hybrid skills as both an architect and a software developer to design and implement robust, scalable, and efficient solutions. You lead the...

  • Pyspark Developer

    1 month ago

    Bengaluru, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...

  • Pyspark Developer

    5 days ago

    Bengaluru, Karnataka, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...

  • Aws Pyspark

    3 weeks ago

    Bengaluru, India Cognizant Full time

    Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark. Hands on experience with EMR Apache Spark...