Optimizing Laravel Performance on AWS with SQS and RDS Connection Issues
I recently switched to After trying multiple solutions online, I still can't figure this out. Currently developing a Laravel application that heavily relies on AWS services, particularly SQS for queuing jobs and RDS for database management. I’ve noticed that the job queue processing isn’t as performant as it should be, especially under load. After conducting some profiling, it’s clear that the database connections during job execution are creating bottlenecks. To mitigate latency, I’ve implemented connection pooling using the `laravel-connection-pool` package, aiming to reuse connections rather than create new ones for each job. Here’s a glimpse of my configuration: ```php // config/database.php 'connections' => [ 'mysql' => [ 'driver' => 'mysql', 'host' => env('DB_HOST', '127.0.0.1'), 'port' => env('DB_PORT', '3306'), 'database' => env('DB_DATABASE', 'forge'), 'username' => env('DB_USERNAME', 'forge'), 'password' => env('DB_PASSWORD', ''), 'charset' => 'utf8mb4', 'collation' => 'utf8mb4_unicode_ci', 'prefix' => '', 'strict' => true, 'engine' => null, 'pooling' => true // Custom option for pooling ], ], ``` Even with this setup, I still face issues where some jobs timeout, especially when they involve complex database queries. I’ve tried increasing the timeout settings in `config/queue.php`: ```php 'timeout' => 90, // Increasing timeout to 90 seconds ``` But it seems that jobs are still intermittently failing. Moreover, I’ve noticed that when jobs are executed, they consume excessive memory. It feels like the jobs are somehow holding onto connections longer than expected. I am also concerned about how the `mysql` service on RDS is configured, as I suspect the instance type may not be sufficient for the load. I’ve considered switching our database to Aurora for better scalability, but I’d like to explore optimizing the existing configuration before making that leap. Has anyone experienced similar issues with Laravel on AWS, particularly in relation to SQS job processing and RDS performance? Any insights on configuration settings or best practices would be greatly appreciated. Additionally, if there are any specific metrics I should monitor that could help identify the root cause of these delays, that information would be extremely helpful as well. Any help would be greatly appreciated! For context: I'm using Php on Linux. I'd really appreciate any guidance on this. Any ideas how to fix this?