Senior BigData Developer krtrimaIQ Cognitive Solutions

About KrtrimaIQ Cognitive Solutions

Job Description

Job Title: Senior Big Data Developer (PySpark) Location: Bangalore (Hybrid) Experience: 57 Years Employment Type: Full-Time Job Description: We are hiring a Senior Big Data Developer with strong hands-on experience in PySpark and the Apache Big Data ecosystem. In this role, you will design, develop, and optimize scalable data pipelines while collaborating with cross-functional teams to deliver reliable, high-performance data solutions. Key Responsibilities: Build and optimize large-scale data processing pipelines using PySpark Work with Apache Hadoop, Hive, HDFS, Spark, and other tools for managing big data workloads Handle ETL development, data ingestion, transformation, and integration from various sources Collaborate with Data Scientists, Analysts, and business stakeholders to deliver data-driven solutions Ensure high availability, performance, and scalability of data jobs Implement data quality checks and lineage tracking for auditability Develop reusable code in Python and Java Use Apache NiFi for automated data flow management (if applicable) Contribute to architectural design, performance tuning, and tech discussions Required Skills & Qualifications: 57 years of experience as a Big Data Developer Expertise in PySpark and distributed data processing Strong knowledge of the Apache ecosystem: Hadoop, Hive, HDFS, Spark Experience with ETL pipelines, data modeling, and data warehousing Proficiency in Python and working knowledge of Java Familiarity with SQL/NoSQL databases Hands-on experience with Git, CI/CD tools, and code versioning Nice-to-Have Skills: Knowledge of Apache NiFi Experience with real-time data streaming tools Exposure to cloud platforms AWS, Azure, or GCP Familiarity with Docker, Kubernetes, or other orchestration tools Soft Skills: Excellent problem-solving and analytical abilities Strong collaboration and communication skills Self-starter with the ability to work independently and in a team Education: Bachelors or Masters in Computer Science, Information Systems, or a related field How to Apply: If youre passionate about big data and want to work on impactful projects, send your updated resume to: nikhil.kumar@krtrimaiq.ai,