PRIMUS Global Solutions (PRIMUS UK & Europe)
Senior Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Role Overview
Should be able to Develop and write telecom network performance data parsers in for multiple file formats (XML, ASN.1) & convert into an acceptable Parquet columnar output. Knowledge & experience of Iceberg Table format is preferred.
Responsibilities
- Implement Lambda functions triggered by S3 event notifications via SQS queues for high-throughput parsing.
- Build & implement code for robust error handling with retries, DLQ, and SNS notifications.
- Build a schema management in line with vendor mapping files & write code for updating the schema dynamically with addition of new counters to an extent of automating it.
- Support schema deployment, upgrades, and rollback processes not including user configurations for ignoring counters, grouping overrides, dimension preservation, and counter name mappings.
- Handle schema upserts and merges to simultaneously insert new records and update existing ones.
- Own the end-to-end lifecycle of schemas including versioning, updates, and retirement.
- Thoroughly understand the 15 / 60 PM counter granularity and able to write codes for aggregation.
- Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse.
- Work with Amazon MSK (Kafka) for real-time data ingestion and streaming.
- Automate pipeline orchestration with AWS Step Functions.
- Ensure schemas are aligned with vendor (OEM) specifications and business requirements.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Skills and Experience
Get help with your application
Your very own career expert that helps elevate your application to the next level.
- Thorough knowledge of writing building audit logging and metadata in DynamoDB & forwarding the details via CloudWatch.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location