python

Job Description – Python / PySpark / AWS / REST API Developer

Position

Python / PySpark / AWS Developer

Experience

3–6 Years

Job Location

Bengaluru / Hybrid

Role Overview

We are looking for a skilled Python / PySpark / AWS Developer to design, develop, and maintain scalable data processing solutions and REST APIs. The ideal candidate should have strong experience in Python programming, distributed data processing using PySpark, AWS cloud services, and API development/integration.

Key Responsibilities

• Develop and maintain scalable data processing applications using Python and PySpark.

• Design and implement data pipelines for processing large volumes of structured and unstructured data.

• Develop, integrate, and maintain RESTful APIs using frameworks such as FastAPI or Flask.

• Work with AWS services to build and deploy cloud-based data solutions.

• Develop PySpark jobs for data transformation, cleansing, aggregation, and enrichment.

• Optimize Spark applications for performance, scalability, and cost efficiency.

• Integrate REST APIs with internal applications, databases, and external systems.

• Implement API authentication, authorization, validation, error handling, and logging.

• Work with AWS services such as S3, Lambda, Glue, EC2, EMR, CloudWatch, IAM, and API Gateway.

• Build and maintain data ingestion pipelines from APIs, databases, files, and other data sources.

• Write reusable, maintainable, and well-tested Python code.

• Troubleshoot production issues and perform root-cause analysis.

• Collaborate with data engineers, software engineers, DevOps teams, and business stakeholders.

• Participate in code reviews, unit testing, deployment, and production support.

Required Skills

Python

• Strong proficiency in Python 3.x.

• Experience with object-oriented programming and Python best practices.

• Experience with libraries such as Pandas, Requests, Pytest, etc.

• Good understanding of exception handling, logging, multiprocessing/threading, and package manage