Spark Professional
11 hours ago
Client Name : Nishant Jain ; JD: Spark & Delta Lake Understanding of Spark core concepts like RDDs DataFrames DataSets SparkSQL and Spark Streaming. Experience with Spark optimization techniques. Deep knowledge of Delta Lake features like time travel schema evolution data partitioning. Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. Proficiency in Python/Scala/Java for Spark development and integrate with ETL process. Knowledge of data ingestion techniques from various sources (flat files CSV API database) Understanding of data quality best practices and data validation techniques. Other Skills: Understanding of data warehouse concepts data modelling techniques. Expertise in Git for code management. Familiarity with CI/CD pipelines and containerization technologies. Nice to have experience using data integration tools like DataStage/Prophecy/Informatica/Ab Initio
-
Java, Spark Professional
9 hours ago
Hyderabad, Telangana, India Growel Softech Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearDevelop Spark Applications: Design and develop Spark applications using Java to process and analyze large data sets. Data Integration: Integrate various data sources such as databases, data lakes, and cloud storage into Spark applications. Optimize Performance: Optimize Spark jobs for performance, ensuring efficient execution of tasks and minimizing resource...
-
SEO Executive
1 week ago
Hyderabad, Telangana, India Spark Infosys Full time ₹ 80,000 - ₹ 1,20,000 per yearCompany DescriptionSpark Infosys is a leading Web Development Company based in Hyderabad. We offer a wide range of services including Website Development, SEO Services, E-Commerce Portal Development, Website Designing, Web Maintenance, Domain and Web Hosting, and Bulk SMS solutions. We adopt a consultative approach to business problems, working closely with...
-
Scala Professional
4 days ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 40,00,000 - ₹ 1,20,00,000 per yearPrevious candidates does not have much knowledge on the Scala side and was also lagging in spark concepts.Hands on experience of 4-5 years on Spark-Scala combinationAwareness of Hive DBAwareness and experience of working on Hadoop platformGood SQL knowledge
-
Big Data Professional
10 hours ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 4,00,000 - ₹ 12,00,000 per yearPython, big data (Hive, spark or snowflake, Kafka), SQL/ SQLServer. Experience in Python for data processing.
-
App DevOps Professional
6 hours ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled App DevOps professional with 5-10 years of experience to join our team. The ideal candidate will have expertise in Data Ingestion, Release Management, Monitorization, Incident Review, Databricks, Azure Cloud, and Data Analysis.Roles and ResponsibilityImplement and manage data ingestion processes to acquire data from various...
-
Python Developer
7 hours ago
Hyderabad, Telangana, India Crisil Full time ₹ 4,00,000 - ₹ 12,00,000 per yeari am looking for java resource for model infinity project that is suitable for professionals with 2-5 years of experince and a strong in python, spark
-
Resident Solutions Architect
1 week ago
Hyderabad, Telangana, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Koantek: Koantek is a Databricks Pure-Play Elite Partner, helping enterprises modernize faster and unlock the full power of Data and AI. Backed by Databricks Ventures and honored as a six-time Databricks Partner of the Year, we enable global enterprises to modernize at speed, operationalize AI, and realize the full value of their data. Our deep...
-
Senior Data Engineer
5 hours ago
Hyderabad, Telangana, India Indium Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are looking for a highly skilled Data Engineer with 4+ years of experience in building scalable data pipelines, transforming large datasets, and working with modern data platforms. The ideal candidate is proficient in Python, SQL, Apache Spark, and Google Cloud Platform (GCP), and demonstrates strong communication and collaboration skills. You will play a...
-
Data Engineer
2 weeks ago
Hyderabad, Telangana, India BOHIYAANAM TALENT SOLUTIONS LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per yearDescription :Key Responsibilities : - Design, develop, and deploy end-to-end data engineering solutions using Databricks, Apache Spark, PySpark, Python, and SQL. - Build scalable and efficient ETL/ELT pipelines for data ingestion, transformation, and integration from various sources. - Work with data warehousing solutions and ensure...
-
Solution Architect
2 weeks ago
Hyderabad, Telangana, India Deloitte Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExecutive Manager – Solution Architect - Deloitte Support Services India Private LimitedKey Responsibilities/Job Duties:With 13 – 15 years of hands-on experience developing applications leveraging the following skills.Lead Data Engineering Team: Lead, mentor, and manage a team of 10+ data engineers, providing technical guidance, code reviews, and career...