Senior Engineer-pyspark, Sql, Python And Databricks

2 days ago

Bangalore Karnataka, India Thales Full time

Location Bangalore India Thales people architect solutions that enable two-thirds of planes to take off and land safely We create in-flight entertainment systems that engross 50 million fliers every year and we develop the avionics that control the world s largest commercial aircrafts Our simulators train the next generation of pilots for fighter jets transporters and search and rescue helicopters And together each and every member of our aerospace team makes a difference Present in India since 1953 Thales is headquartered in Noida Uttar Pradesh and has operational offices and sites spread across Bengaluru Delhi Gurugram Hyderabad Mumbai Pune among others Over 1800 employees are working with Thales and its joint ventures in India Since the beginning Thales has been playing an essential role in India s growth story by sharing its technologies and expertise in Defence Transport Aerospace and Digital Identity and Security markets Essential Functions Key Areas of Responsibility Expert in Python with knowledge of PySpark Writing distributed data processing code with PySpark Optimizing Spark jobs using DataFrames API and RDDs Working with Spark SQL for querying large datasets structured sql mysql database Implementing UDFs User Defined Functions for custom transformations Performance tuning caching partitioning broadcast joins threading multiprocessing Predicate Pushdown ETL development using Databricks workflows and Delta Live Tables Data pipelines with Databricks Jobs Streaming data processing with Structured Streaming event hub or AWS SQS Non structured file processing like parquet columnar data format Responsible for writing reusable testable and efficient code ensuring the application s performance security and scalability Excellent problem-solving ability with solid communication and collaboration skills Provide technical documentation for system features and components Follow and support agile methodologies and practices by actively participating in all SCRUM ceremonies Minimum Requirements Skills Experience Education Technical Specialized Knowledge Certifications Language Bachelor s degree in Engineering Computer Science or related study Proven experience as a Python language with PySpark Minimum 3 years of experience Understanding of data structures data modeling and software architecture Ability to write robust code in Python Outstanding analytical and problem-solving skills Experience with Git JIRA Confluence Experience in working on Linux OS Excellent written and verbal communication At Thales we provide CAREERS and not only jobs With Thales employing 80 000 employees in 68 countries our mobility policy enables thousands of employees each year to develop their careers at home and abroad in their existing areas of expertise or by branching out into new fields Together we believe that embracing flexibility is a smarter way of working Great journeys start here apply now

  • Python, SQL, Adf, Databricks

    3 days ago

    Bengaluru, Karnataka, India Vinncraft Software Pvt Ltd Full time

    **Job description**: in Python, SQL, ADF, Databricks (PySpark, DLT, Unity Catalog, Performance Tuning, Cost Optimization) along with leadership(self SKILLS: Python, SQL, ADF, Databricks Total experience 7-13 Yrs Pay: ₹1,400,000.00 - ₹1,500,000.00 per year Work Location: In person

  • Azure Databricks Along with Python

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Inviting Applications for Azure Databricks along with Python Job Title: Azure Databricks along with Python Experience Required: 4 to 10 Years Location: Bangalore - Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark - Proficient with...

  • Azure databricks, PySpark

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Role: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...

  • Data Engineer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Azure DataBricks, Pyspark)Exp range – 4 yrs – 6 yrsLocation- Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarNotice period – 30-60Pls find the Job Description below.5+ yrs. Development experience with Spark (PySpark), Python and SQL.Extensive knowledge...

  • Urgent Search: Data Engineer

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer (Azure DataBricks, Pyspark) Exp range – 4 yrs – 6 yrs Location- Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Notice period – 30-60 Pls find the Job Description below. - 5+ yrs. Development experience with Spark (PySpark), Python and SQL. -...

  • Azure Databricks with Pyspark

    5 days ago

    Bengaluru, Karnataka, India BirlaSoft Full time

    Country/Region: IN - Requisition ID: 25277 - Work Model: - Position Type: - Salary Range: - Location: INDIA - BENGALURU - HP **Title**:Azure Databricks with Pyspark**: - Description: **Area(s) of responsibility**: Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise...

  • Data Engineer

    1 week ago

    bangalore, India VSquare Systems Pvt. Ltd. Full time

    Job Description:We are looking for a highly skilled Databricks PySpark Developer to join our data platform implementation team. In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into data lake and data warehouse. You will work...

  • Data Engineer

    2 weeks ago

    Bangalore, India VSquare Systems Pvt. Ltd. Full time

    Job Description: We are looking for a highly skilled Databricks PySpark Developer to join our data platform implementation team. In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into data lake and data warehouse. You...

  • Data Engineer

    2 weeks ago

    Bangalore Urban, India Tata Consultancy Services Full time

    Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer ( Azure DataBricks, Pyspark) Exp range – 4 yrs – 6 yrs Location- Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Notice period – 30-60 Pls find the Job Description below. 5+ yrs. Development experience with Spark (PySpark), Python and SQL. Extensive...

  • Data Engineer

    2 weeks ago

    Bangalore Urban, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Azure DataBricks, Pyspark)Exp range – 4 yrs – 6 yrsLocation- Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarNotice period – 30-60Pls find the Job Description below.5+ yrs. Development experience with Spark (PySpark), Python and SQL.Extensive knowledge...