Cranium Information Technology

1 month ago

Hyderabad, India cranium IT Full time

Job Summary :

We are looking for an experienced On-Premises Apache Spark Developer to join our team. The ideal candidate will have 6-8 years of experience in developing and managing large-scale data processing applications using Apache Spark in on-premises environments. You will play a critical role in optimizing and scaling our data infrastructure to support high-performance data processing and analytics.

Key Responsibilities :

1. Apache Spark Development :

- Design, develop, and maintain complex data processing applications using Apache Spark in an on- premises environment.

- Implement Spark jobs for batch and real-time data processing, ensuring efficient use of resources and scalability.

- Optimize Spark applications for performance, including tuning Spark jobs, managing resources, and debugging issues.

2. Data Integration & ETL :

- Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from various on- premises sources.

- Ensure data quality, consistency, and reliability across all stages of the data pipeline.

- Work with large datasets to perform data wrangling, cleaning, and transformation as needed.

3. System & Infrastructure Management :

- Collaborate with system administrators to manage and monitor the on-premises Hadoop and Spark infrastructure.

- Ensure the stability, security, and performance of the Spark cluster, including monitoring and troubleshooting any issues.

- Participate in capacity planning and scaling of the Spark environment based on business needs.

4. Collaboration & Documentation :

- Work closely with data engineers, data scientists, and other stakeholders to understand data requirements and deliver efficient solutions.

- Document the architecture, design, and implementation of Spark jobs and workflows for future reference and audits.

5. Performance Tuning & Optimization :

- Analyze and optimize Spark job performance, including caching, partitioning, and job scheduling.

- Identify and resolve performance bottlenecks in the Spark environment.

6. Security & Compliance :

- Implement security best practices for managing sensitive data within the Spark ecosystem.

- Ensure compliance with organizational policies and industry regulations.

Required Qualifications :

- 6 to 8 years of experience in developing and managing Apache Spark applications in an on-premises environment.

- Strong proficiency in programming languages such as Java, Scala, or Python for Spark development.


- Deep understanding of Spark architecture, including RDDs, DataFrames, and SparkSQL.

- Experience with performance tuning and optimizing Spark jobs.

- Solid understanding of data warehousing concepts, data modeling, and ETL processes.

- Excellent problem-solving skills and attention to detail.

- Strong communication skills and ability to work in a team-oriented environment.

Preferred Qualifications :

- Familiarity with DevOps practices, CI/CD pipelines, and version control systems like Git.


- Knowledge of containerization and orchestration tools such as Docker and Kubernetes.

- Experience with data security and governance practices in an on-premises environment.


- Certifications in Apache Spark or related big data technologies.

(ref:hirist.tech)

  • Cranium IT iOS Developer

    4 weeks ago

    Hyderabad, Telangana, India cranium IT Full time

    **Job Title:** iOS Developer at Cranium ITWe are looking to expand our team with an experienced iOS developer who can help us design and build high-quality applications for the iOS platform. As an iOS developer at Cranium IT, you will be responsible for writing clean, efficient, and well-documented code and working closely with our team to ensure the timely...

  • Senior iOS Application Developer

    3 weeks ago

    Hyderabad, Telangana, India cranium IT Full time

    Job Title: Cranium Information TechnologyJob Description:We are seeking a skilled iOS developer to join our team at Cranium Information Technology. As an iOS developer, you will be responsible for designing and building applications for the iOS platform using latest technologies and frameworks.Key Responsibilities:- Design and develop high-quality iOS...

  • Cranium Information Technology

    1 month ago

    Hyderabad, India cranium IT Full time

    Location : Hyderabad. Experience : 7-11 Years. Working Days : 5 Days. Notice Period : Immediate or 15 days maximum. Rate : Market. Job Description : We are seeking an experienced Azure Data Engineer to join our team in Hyderabad.- The ideal candidate will have 7-11 years of experience and possess a strong background in designing, developing, and managing...

  • Cranium Information Technology

    1 month ago

    Hyderabad, India cranium IT Full time

    Job Description (iOS) :We are looking for an iOS developer responsible for the development and maintenance of applications aimed at a range of iOS devices including iPhones and iPads. Your primary focus will be the development of iOS applications and their integration with back-end services. You will be working alongside other engineers and developers...

  • Cranium Information Technology

    2 months ago

    Hyderabad, India cranium IT Full time

    As a Salesforce Service/Marketing/Sales Cloud Technical Lead, you will be responsible for developing and implementing Service, Sales, and Marketing automation solutions with the Salesforce Cloud platform. You will collaborate with cross-functional teams to design, develop, and implement solutions using the Salesforce Cloud platform to meet customer...

  • Salesforce Technical Lead

    4 weeks ago

    Hyderabad, Telangana, India cranium IT Full time

    **About the Role**As a Salesforce Technical Lead at Cranium Information Technology, you will be responsible for developing and implementing Service, Sales, and Marketing automation solutions with the Salesforce Cloud platform. You will collaborate with cross-functional teams to design, develop, and implement solutions using the Salesforce Cloud platform to...

  • Data Processing Engineer

    4 weeks ago

    Hyderabad, Telangana, India cranium IT Full time

    Data Processing EngineerWe are seeking an experienced Data Processing Engineer to develop and manage large-scale data processing applications using Apache Spark in an on-premises environment. Key Responsibilities include:Apache Spark Development: Design, develop, and maintain complex data processing applications using Apache Spark, implementing Spark jobs...

  • Technical Architect

    1 month ago

    Bangalore/Pune/Hyderabad/Chennai/Noida/Ahmedabad/Mumbai/Kolkata, India cranium IT Full time

    Job Title: Technical ConsultantJob Summary:We are seeking a highly skilled Technical Consultant to join our team at cranium IT. The successful candidate will have a strong background in enterprise application integration and a proven track record of designing, developing, and deploying complex integration solutions using Oracle Integration Cloud (OIC).Key...

  • Apache Spark Data Processing Engineer

    4 weeks ago

    Hyderabad, Telangana, India cranium IT Full time

    Job Summary: We are seeking an experienced Apache Spark Developer to join our team at Cranium IT. The ideal candidate will have a deep understanding of Apache Spark architecture and will be able to design, develop, and maintain complex data processing applications using Apache Spark in an on-premises environment.Key Responsibilities:Apache Spark Development:...

  • Senior Integration Architect

    4 weeks ago

    Bangalore/Pune/Hyderabad/Chennai/Noida/Ahmedabad/Mumbai/Kolkata, India cranium IT Full time

    Integration Architect RoleAt cranium IT, we are seeking a highly skilled Integration Architect to lead our integration architecture and design efforts. As a key member of our team, you will be responsible for designing and developing complex integration solutions using OIC, considering scalability, security, performance, and reusability.Key...

  • SID Information Technologies | PMO Information Security Manager | hyderabad

    2 weeks ago

    hyderabad, India SID Information Technologies Full time

    #CyberSecurity #Architect #Project #Management #PMO #Information #Security #Program #manager #Lead #Hiring #ImmediateJoiner We are hiring Security Technical Program manager for our Health Care Clien t Role: PMO Security Technical /Cyber Security / Program Manager Information Security Location: Hyderabad/Hybrid Experience: 7+ ye ars of experience in cyber...

  • SID Information Technologies | PMO Information Security Manager | hyderabad

    1 week ago

    hyderabad, India SID Information Technologies Full time

    #CyberSecurity #Architect #Project #Management #PMO #Information #Security #Program #manager #Lead #Hiring #ImmediateJoiner We are hiring Security Technical Program manager for our Health Care Clien t Role: PMO Security Technical /Cyber Security / Program Manager Information Security Location: Hyderabad/Hybrid Experience: 7+ ye ars of experience in cyber...

  • SID Information Technologies | PMO Information Security Manager | hyderabad

    1 week ago

    hyderabad, India SID Information Technologies Full time

    #CyberSecurity #Architect #Project #Management #PMO#Information #Security #Program #manager #Lead#Hiring #ImmediateJoinerWe are hiring Security Technical Program manager for our Health Care ClientRole: PMO Security Technical /Cyber Security / Program Manager Information SecurityLocation: Hyderabad/HybridExperience: 7+ years of experience in cyber...

  • SID Information Technologies | PMO Information Security Manager | hyderabad

    1 week ago

    hyderabad, India SID Information Technologies Full time

    #CyberSecurity #Architect #Project #Management #PMO #Information #Security #Program #manager #Lead #Hiring #ImmediateJoiner We are hiring Security Technical Program manager for our Health Care Clien t Role: PMO Security Technical /Cyber Security / Program Manager Information Security Location: Hyderabad/Hybrid Experience: 7+ ye ars of experience in cyber...

  • SID Information Technologies | Lead Tableau Developer | hyderabad

    1 week ago

    hyderabad, India SID Information Technologies Full time

    #hiring #tableaudeveloper #lead#sql #immediatejoiner #hyderabadRole: Lead Tableau Developer Location: Hyderabad / USA (San Francisco)10+ years of relevant exp.Hands-on with SQLImmediate JoinerFor US Healthcare Data Analytics clientSkills:Tableau CertificationTableau DashboardStrong with SQLData VisualizationDrop your resume with following details (must) :...

  • SID Information Technologies | Lead Tableau Developer | hyderabad

    1 week ago

    hyderabad, India SID Information Technologies Full time

    #hiring #tableaudeveloper #lead #sql #immediatejoiner #hyderabad Role: Lead Tableau Developer Location: Hyderabad / USA (San Francisco) 10+ years of relevant exp. Hands-on with SQL Immediate Joiner For US Healthcare Data Analytics client Skills: Tableau Certification Tableau Dashboard Strong with SQL Data Visualization Drop your resume with following...

  • SID Information Technologies | Sr. Python Django Developer | hyderabad

    6 days ago

    hyderabad, India SID Information Technologies Full time

    #hiring #python #django #typescript #pythondjango #developer#hyderabadjob#hyderabad#immediatejoinerRole: Sr. Python Django Developer- Exp. : 5+ yrs - Loc. : Hyderabad- For a Data Analytics Client - Immediate Joiner or Max. 30 Days NPSkills:PythonDjangoGITREST API'sReactJsJavaScriptNextJSSQL / Postgres SQLMicroservicesTypeScriptCodingApply here :...

  • SID Information Technologies | Sr.Data Engineer

    2 weeks ago

    hyderabad, India SID Information Technologies Full time

    #hiring #DataEngineer #PythonScala #AWS #SQL #immediatejoiner #hyderabadjobs Role: Sr. Data Engineer / Lead Platform Engineer (Scala / Python with AWS and SQL) Location: Hyderabad/ Remote / Hybrid - For a Healthcare / Genetic Data analytics Client - For immediate joiners only Python Programming OR Scala SQL / NoSQL AWS ETL Pipelines Redshift Terraform ...

  • Information Technology Specialist

    4 weeks ago

    Hyderabad, India Zaineb Ali & Co. Full time

    Company DescriptionWelcome to Zaineb Ali & Co. in India, a sanctuary of strength and serenity where every movement is a masterpiece. Our Pilates studio is a retreat designed to transform your body and elevate your spirit through mindful movement. Join us in celebrating the art of mindful transformation where each session is a journey towards a stronger, more...

  • PMO Information Security Manager

    2 weeks ago

    hyderabad, India SID Information Technologies Full time

    #CyberSecurity #Architect #Project #Management #PMO #Information #Security #Program #manager #Lead #Hiring #ImmediateJoiner We are hiring Security Technical Program manager for our Health Care Clien t Role : PMO Security Technical /Cyber Security / Program Manager Information Security Location: Hyderabad/Hybrid Experie nce: 7+ ye ars of experience in...