Spark

2 days ago

Bengaluru Karnataka, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and maintain scalable data pipelines using Spark in Scala to ensure efficient data processing.
- Implement and manage workflows using Apache Airflow to automate data tasks and ensure timely execution.
- Write clean efficient and maintainable code in Python to support various data engineering tasks.
- Utilize Databricks SQL to perform complex queries and data transformations for analytics and reporting.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Conduct code reviews to ensure code quality and adherence to best practices.
- Troubleshoot and resolve data pipeline issues to maintain data integrity and availability.
- Optimize data processing performance to improve system efficiency and reduce latency.
- Document data workflows processes and code to ensure knowledge sharing and maintainability.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
- Provide technical guidance and mentorship to junior developers to foster team growth.
- Participate in agile ceremonies and contribute to sprint planning retrospectives and daily stand-ups.
- Ensure compliance with data governance and security policies to protect sensitive information.

**Qualifications**
- Must have strong experience in Spark in Scala for developing scalable data pipelines.
- Must have hands-on experience with Apache Airflow for workflow automation.
- Must be proficient in Python for data engineering tasks.
- Must have experience with Databricks SQL for data querying and transformation.
- Nice to have experience in Asset Management Operations domain.
- Must have excellent problem-solving skills and attention to detail.
- Must have strong communication and collaboration skills.
- Must be able to work in a hybrid work model with day shifts.
- Must be able to work independently and as part of a team.
- Must have a proactive attitude and a willingness to learn new technologies.
- Must have a strong understanding of data governance and security practices.
- Must be able to document processes and code effectively.

**Certifications Required**

Certified Spark Developer Apache Airflow Certification Python Certification

  • Java+spark+microservices

    2 days ago

    Bengaluru, Karnataka, India Skillety Technologies Full time

    **skill Set**: Java, Microservices, Spark & SQL** - Minimum 5-10 years of experience - Good hands-on experience in Java, J2EE - Should take up ownership of tasks - Excellent communication (verbal and Written) - Added advantage of Web API knowledge will be preferred

  • Spark Scala

    1 week ago

    Bengaluru, India Techys Digital Full time

    **Experience**:4-8 Years of Exp. **Location -** Bangalore / Pune **(Multiple Positions) | Immediate to 30 days notice joining need to apply** **Description**: - In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params. - Experience in Hadoop development,...

  • Java Spark Dev

    2 days ago

    Bengaluru, Karnataka, India Virtusa Full time

    Sr. Big Data Engineer Location: Bangalore / Hyderabada) Java + Spark - mandatory skills Java 8 and above, SpringBoot, Junit, REST & Git, relational database and SQL experience Experience with developing Spark Experience in developing with Cloud (AWS), EC2, ECS, S3, NoSQL DB, Amazon RDS, Jenkins, Prometheus, Docker, Kubernetes, JSON, AWS Code...

  • Java Spark Developer

    4 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Primary Skill: Spark, Java programmingStrong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streamingHands-on experience in any one of the programming languages (Java, Scala)Good understanding of distributed programming concepts.Experience in optimizing Spark DAG, and Hive queries on TezExperience using tools like Git, Autosys,...

  • sparking operator

    6 days ago

    Kamakshipalya, Bengaluru, Karnataka, India Moldtech GmbH Full time ₹ 2,40,000 - ₹ 3,60,000 per year

    SPARK EDM OPERATOR TO WORK ON OSCAR MAX ZNC MACHINEWORK PIECE DIALLING, ELECTRODE DIALLING, CENTRALIZING, PROGRAMMING AND INSPECTIONSHOULD BE ABLE TO READ AND INTERPRET 2D DRAWINGSJob Type: Full-timePay: ₹20, ₹30,000.00 per monthBenefits:Health insuranceAbility to commute/relocate:Kamakshipalya, Bengaluru , Karnataka: Reliably commute or planning to...

  • Snowflake, Spark

    4 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Talent Worx is thrilled to announce an exciting opportunity for the roles of Snowflake and Spark Developers Join us in revolutionizing the data analytics landscape as we partner with one of the Big 4 firms in India.What impact will you make?Your contributions will play a vital role in shaping our clients' success stories by utilizing innovative technologies...

  • Scala Spark

    4 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala Spark Exp: 5 to 9 yrs Location: Bengaluru, Pune, Mumbai & Chennai Notice period: Less than 30 days Thanks & Regards, Indumati N

  • Scala Spark

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inhttps://www.linkedin.com/company/alphacom-systems-and-solutions-pvt-ltd/www.alphacom.in

  • Scala Spark

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inwww.alphacom.in

  • Scala Spark

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inwww.alphacom.in