Senior Big Data Developer
2 days ago
Big Data Developer Opportunity
About the RoleWe are seeking a skilled developer to design, build, and manage big data processing and analytics solutions using PySpark within the Databricks platform. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert analysis, development, implementation, and troubleshooting.
The ideal candidate will have hands-on experience with PySpark for big data processing and analytics, as well as strong programming skills in Python. They will also have excellent analytical and problem-solving skills with a methodical approach to complex data challenges.
- Design and Implement Big Data Solutions: Develop scalable data processing pipelines and analytics solutions using PySpark within the Databricks platform.
- Data Ingestion and Transformation: Write efficient PySpark code to extract, transform, and load (ETL/ELT) large volumes of data from various sources into Databricks.
- Data Lake/Warehouse Management: Work with data lake and data warehouse concepts, ensuring data quality, consistency, and efficient storage within Databricks.
- Performance Optimization: Optimize PySpark jobs and Databricks notebooks for performance, cost-efficiency, and scalability.
- Analysis and Insights: Perform complex data analysis using PySpark to uncover insights and support business intelligence and machine learning initiatives.
Bachelor's Degree in Computer Science or Related Field
The successful candidate will possess a bachelor's degree in computer science or a related technical field. Strong verbal and written communication skills are also essential for articulating technical solutions and collaborating effectively within a team.
-
Big Data Developer
2 days ago
Chennai, Tamil Nadu, India IntraEdge Full timeJob Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...
-
Big Data Developer
1 day ago
Chennai, Tamil Nadu, India beBeeBigData Full time ₹ 9,00,000 - ₹ 12,00,000We're seeking experienced Big Data Developers with strong Python skills to contribute to our team's success.Key Responsibilities:Design and develop scalable data pipelines using PySpark and Python.Collaborate with cross-functional teams to implement data processing solutions.Develop expertise in Hadoop, Hive, Spark, and other Big Data technologies.Implement...
-
Big Data Engineering Developer
1 week ago
Chennai, Tamil Nadu, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per yearThe Applications Development Senior Programmer/Lead Analyst is an senior level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...
-
Chennai, Tamil Nadu, India NTT DATA Full timeReq ID 317271NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ITSS-Big Data Hadoop Splunk Developer-HUMJP00032202 to join our team in chennai Tamil Nxc4x81du IN-TN India IN ...
-
Chennai, Tamil Nadu, India Pando Corp Private Limited Full timeAbout the jobSenior Data Warehouse Engineer Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, &...
-
Big Data Engineer
4 days ago
Chennai, Tamil Nadu, India beBeeBigDataEngineer Full timeJob Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...
-
Python developers with Big Data experience
2 days ago
Chennai, Tamil Nadu, India Amazech Solutions Full timeWe are looking for skilled Big Data Developers with Python with strong hands-on experience in PySpark, Python scripting, and Big Data technologies to join our dynamic team.Key Skills Required:- Proficient in Python and PySpark- Strong experience in Big Data ecosystems (Hadoop, Hive, Spark, etc.)- Expertise in scripting for automation and data processing-...
-
Python developers with Big Data experience
21 hours ago
Chennai, Tamil Nadu, India Amazech Solutions Full timeWe are looking for skilled Big Data Developers with Python with strong hands-on experience in PySpark , Python scripting , and Big Data technologies to join our dynamic team. Key Skills Required : Proficient in Python and PySpark Strong experience in Big Data ecosystems (Hadoop, Hive, Spark, etc.) Expertise in scripting for automation and data...
-
Chennai, Tamil Nadu, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000Developers of large-scale data processing systems with expertise in Python are sought to join our dynamic team. As a key member, you will be responsible for developing and implementing scalable data pipelines using Python and PySpark.Key Responsibilities:Design and develop large-scale data processing systemsDevelop scalable data pipelines using Python and...
-
Big Data Engineering Lead- C13
2 weeks ago
Chennai, Tamil Nadu, India Citigroup Full timeThe Senior Big Data engineering lead will play a pivotal role in designing implementing and optimizing large-scale data processing and analytics solutions This role requires a visionary leader who can drive innovation define architecture strategy and ensure the scalability and efficiency of our big data infrastructure Key Responsibilities Lead the...
