Rosaiah Chowdary | Data Engineer

About Me

I am a passionate Data Engineer and ETL DataStage consultant with extensive hands-on experience in designing, developing, and optimizing data integration solutions. Over my career, I have worked with various enterprise datasets, helping businesses unlock the value of their data.

In-depth expertise in IBM DataStage, including parallel job design, performance tuning, troubleshooting, and administration.
Proven track record of collaborating with cross-functional teams to deliver end-to-end data warehousing and migration projects.
Experience integrating data from diverse sources such as relational databases, flat files, and cloud platforms.
Strong problem-solving skills with a focus on data quality, governance, and automation.
Contributed to the modernization of legacy ETL processes and migration to cloud-based data platforms.

My goal is to leverage my technical and consulting skills to enable organizations to gain actionable insights from their data, drive efficiency, and support business growth.

Roles & Responsibilities

Production Support & Operations

Provided end-to-end production support for 90,000+ scheduled jobs, meeting SLAs in high-volume environments.
Proactively monitored critical batch flows, detected failures, and ensured prompt resolution.
Diagnosed abends, errors, and system anomalies in real-time, collaborating with teams to restore services.
Managed incident queues, prioritized tasks, and coordinated with stakeholders for effective resolution.

Issue Resolution & Root Cause Analysis

Conducted thorough root cause analysis for recurring issues and documented findings.
Managed urgent change requests, ensuring data consistency and compliance.
Addressed conversion issues during migrations/updates, minimizing business risks.

DataStage Job Development & Enhancements

Designed robust DataStage jobs per mapping documents and requirements.
Engineered jobs leveraging a wide range of DataStage stages for performance and reusability.
Enhanced and tuned jobs based on analysis and DBA recommendations.
Led deployments across all lifecycle environments for seamless transitions.

Data Extraction & Integration

Extracted, transformed, and loaded data from diverse sources (databases, Excel, CSV, flat files).
Orchestrated complex data flows, ensuring integrity and accuracy.
Supported data import/export activities, integrating with downstream platforms.

Documentation & Knowledge Management

Authored comprehensive technical specifications, logic descriptions, and mappings.
Maintained job inventory, schedules, and table definitions.
Developed user guides and quick-reference materials for team and business users.

Testing & Quality Assurance

Defined and executed system, integration, and UAT test plans.
Logged and tracked defects, supported remediation, and ensured deployment readiness.

Client & Stakeholder Engagement

Acted as primary contact for client incidents and service requests.
Conducted regular meetings with stakeholders to review incidents and enhancements.
Contributed to automation and improvement initiatives.

Deployment & Change Management

Managed deployment activities including code migration, scheduling, and cutover.
Coordinated with cross-functional teams for smooth rollout of new/enhanced jobs with minimal disruption.

Skills

ETL Development & Support

Designing, building, and managing Extract, Transform, Load processes to ensure clean, consistent, and reliable data movement across systems.

IBM DataStage

Advanced expertise in DataStage for scalable ETL job design, parallel processing, tuning, and operational support.

SQL & PL/SQL

Writing optimized queries, stored procedures, and scripts for data extraction, transformation, and performance tuning.

Python for Data Engineering

Automating data workflows, scripting ETL logic, and building custom data solutions using Python.

Data Warehousing

Designing and implementing data models, warehouses, and marts for analytical and reporting solutions.

Apache Kafka, MQ

Integrating real-time data streams and messaging solutions for event-driven architectures and batch processing.

Cloud (AWS, GCP)

Implementing and migrating data solutions to cloud platforms, leveraging managed services for storage, computation, and orchestration.

Git, Jenkins, CI/CD

Managing source control, automating deployments, and ensuring robust, repeatable data engineering processes.