base table or view not found with AWS SQS queue for job TenantAware #505
Comments
|
What is your default connection? |
This was referenced Jan 12, 2024
|
My Default connection is mysql. I have 3 connections setup: see my config/database.php file below: |
|
dump of the error below: |
|
@masterix21 i have added the above log for the issue i am currently receiving. I did make some changes, see below my config/multitenancy.php file <?php
use Illuminate\Broadcasting\BroadcastEvent;
use Illuminate\Events\CallQueuedListener;
use Illuminate\Mail\SendQueuedMailable;
use Illuminate\Notifications\SendQueuedNotifications;
use Spatie\Multitenancy\Actions\ForgetCurrentTenantAction;
use Spatie\Multitenancy\Actions\MakeQueueTenantAwareAction;
use Spatie\Multitenancy\Actions\MakeTenantCurrentAction;
use Spatie\Multitenancy\Actions\MigrateTenantAction;
use App\Models\Tenant;
return [
/*
* This class is responsible for determining which tenant should be current
* for the given request.
*
* This class should extend `Spatie\Multitenancy\TenantFinder\TenantFinder`
*
*/
//'tenant_finder' => \Spatie\Multitenancy\TenantFinder\DomainTenantFinder::class,
'tenant_finder' => \App\Multitenancy\DomainTenantFinder::class,
/*
* These fields are used by tenant:artisan command to match one or more tenant
*/
'tenant_artisan_search_fields' => [
'id',
],
/*
* These tasks will be performed when switching tenants.
*
* A valid task is any class that implements Spatie\Multitenancy\Tasks\SwitchTenantTask
*/
'switch_tenant_tasks' => [
\Spatie\Multitenancy\Tasks\PrefixCacheTask::class,
\Spatie\Multitenancy\Tasks\SwitchTenantDatabaseTask::class,
\Spatie\Multitenancy\Tasks\SwitchRouteCacheTask::class,
\App\Multitenancy\PrefixStorageTask::class,
\App\Multitenancy\LaravelDailyInvoice::class,
],
/*
* Prefix - allows you to specify a prefix when creating a new database
* note this is not apart of the plugin, its used on the tenantObserver
*/
'prefix' => env('DB_MULTI_PREFIX','db_'),
/*
* This class is the model used for storing configuration on tenants.
*
* It must be or extend `Spatie\Multitenancy\Models\Tenant::class`
*/
'tenant_model' => Tenant::class,
/*
* If there is a current tenant when dispatching a job, the id of the current tenant
* will be automatically set on the job. When the job is executed, the set
* tenant on the job will be made current.
*/
'queues_are_tenant_aware_by_default' => true,
/*
* The connection name to reach the tenant database.
*
* Set to `null` to use the default connection.
*/
'tenant_database_connection_name' => null,
/*
* The connection name to reach the landlord database
*/
'landlord_database_connection_name' => 'landlord',
/*
* This key will be used to bind the current tenant in the container.
*/
'current_tenant_container_key' => 'currentTenant',
/**
* Set it to `true` if you like to cache the tenant(s) routes
* in a shared file using the `SwitchRouteCacheTask`.
*/
'shared_routes_cache' => true,
/*
* You can customize some of the behavior of this package by using your own custom action.
* Your custom action should always extend the default one.
*/
'actions' => [
'make_tenant_current_action' => MakeTenantCurrentAction::class,
'forget_current_tenant_action' => ForgetCurrentTenantAction::class,
'make_queue_tenant_aware_action' => MakeQueueTenantAwareAction::class,
'migrate_tenant' => MigrateTenantAction::class,
],
/*
* You can customize the way in which the package resolves the queuable to a job.
*
* For example, using the package laravel-actions (by Loris Leiva), you can
* resolve JobDecorator to getAction() like so: JobDecorator::class => 'getAction'
*/
'queueable_to_job' => [
SendQueuedMailable::class => 'mailable',
SendQueuedNotifications::class => 'notification',
CallQueuedListener::class => 'class',
BroadcastEvent::class => 'event',
],
/*
* Jobs tenant aware even if these don't implement the TenantAware interface.
*/
'tenant_aware_jobs' => [
\App\Jobs\AddToWhitelistJob::class,
\App\Jobs\AnprCameraImportJob::class,
\App\Jobs\ChangedBatchToProcessedJob::class,
\App\Jobs\PopulateAnprCameraImportVehicleJob::class,
\App\Jobs\PopulateAnprImportReportsJob::class,
\App\Jobs\PopulateVehicleDvlaData::class,
\App\Jobs\ProcessPaygInvoiceJob::class,
\App\Jobs\RefundInvoice::class,
\App\Jobs\UpdateStripeCustomerDetails::class,
\App\Jobs\AddVehicleToUserJob::class,
\App\Jobs\ProcessAnprFactoryJob::class,
],
/*
* Jobs not tenant aware even if these don't implement the NotTenantAware interface.
*/
'not_tenant_aware_jobs' => [
// ...
],
];The Job Class that is failing: <?php
namespace App\Jobs;
use App\Anpr\AnprFactory;
use App\Models\CarparkAnprRead;
use App\Models\CarparkCamera;
use App\Models\Tenant;
use App\Models\Vehicle;
use Illuminate\Bus\Queueable;
use Illuminate\Contracts\Queue\ShouldQueue;
use Illuminate\Foundation\Bus\Dispatchable;
use Illuminate\Queue\InteractsWithQueue;
use Illuminate\Queue\SerializesModels;
use Illuminate\Support\Facades\Artisan;
use Illuminate\Support\Facades\Log;
use Spatie\Multitenancy\Jobs\TenantAware;
use Throwable;
class ProcessAnprFactoryJob implements ShouldQueue,TenantAware
{
use Dispatchable, InteractsWithQueue, Queueable, SerializesModels;
public $carparkAnprReadId;
public $carparkCameraId;
public $vehicleId;
public $useTenantId;
/**
* Create a new job instance.
*/
public function __construct($carparkAnprReadId,$carparkCameraId,$vehicleId,$useTenantId)
{
$this->carparkAnprReadId = $carparkAnprReadId;
$this->carparkCameraId = $carparkCameraId;
$this->vehicleId = $vehicleId;
$this->useTenantId = $useTenantId;
}
/**
* Execute the job.
*/
public function handle(): void
{
$tenant = Tenant::current();
if(is_null($tenant)) {
$tenant = Tenant::find($this->useTenantId);
$tenant->makeCurrent();
} elseif(!is_null($tenant) && $tenant->id != $this->useTenantId) {
Tenant::forgetCurrent();
$tenant = Tenant::find($this->useTenantId);
$tenant->makeCurrent();
}
$carparkAnprRead = CarparkAnprRead::findOrFail($this->carparkAnprReadId);
$carparkCamera = CarparkCamera::findOrFail($this->carparkCameraId);
$vehicle = Vehicle::findOrFail($this->vehicleId);
activity('ANPR API')->log('the anpr factory job has started');
$factory = new AnprFactory();
$factory->process($carparkAnprRead, $carparkCamera,$vehicle);
activity('ANPR API')->log('the anpr factory job has ended');
}
/**
* Handle a job failure.
*/
public function failed(Throwable $exception): void
{
Log::error('ProcessAnprFactoryJob job failed: '.$exception->getMessage());
Artisan::call('queue:restart');
}
}The client/code that is calling the above job class, i: ProcessAnprFactoryJob::dispatch($carparkAnprRead->id, $carparkCamera->id, $vehicle->id, $tenantId)->onConnection('sqs'); |
|
The issue concerns your landlord connection: could you make it default in your .env? Are you sure that |
|
@masterix21 table tenants should only be in the landlord connection database which is set in the .env file initially. If I make the landlord connection default I receive an error: your tenant_database_connection_name is empty, please make the tenant connection. If i change the tenant_database_connection_name to tenant then every entry in the tenants table becomes the landlords database. I think its something to do with the landlord connection which doesn't seem to be setting the database, hence it defaults to the tenant database instead and tries to find the tenants table in the db_lgnhs database. I dont know if this is the issue, but none of my models are set to use UseTenantsConnection except the Tenant model which I created and extended from the original Tenants model which defaults to useLandlordConnection. Other than that I am out of ideas. |
|
I believe this is the same issue I've been struggling with as well. I have found that my scheduled queued jobs seem to work OK if I keep queuing items at a regular interval. However, if I don't have a job drop onto the queue for ~15 minutes it tends to fail. Here is the relevant portion of the stack trace found on the failed jobs list in horizon. It indicates that it's trying to search for the tenant but it is using the tenant database when it should be using the landlord connection. The landlord user doesn't have permissions to read the tenant databases, and it's trying to read the I'd be happy to provide any additional info that can help get to the bottom of this. |
|
@anotherZero same here, it happens once a day after nothing sent to the queue for approx 8 hours. |
|
@masterix21 do you have an update regarding this issue? |
|
Hi @MattWiseParking, sorry, but no, because I have no AWS SQS instances. |
|
I'm having something similar when job starts the default connection is set to tenant the tenant connection with null host |
|
@gssj85, please post your error. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi
I am receiving intermittent issues with a job that sometimes it works sometimes it doesnt. I receive the following error:
The field in my multitenancy is set:
'queues_are_tenant_aware_by_default' => false,The Job class:
Sometimes the job fails with the above error and some times it doesnt, its a but hit and miss, more recently the job has failed
There is no other jobs execute inside the
$factory->processcodeI am using:
Laravel version 10.13.5
spatie multi tenancy version: 3.0.3
the client calling the above job is in fact in the api routes, several tests that the tenant id is being called correctly from this code.
Struggling to understand why its causing intermittent issues? should i pass the tenant ID to the job, and make the job NotTenantAware then in the code just call
$tenant = app('currentTenant'); $tenant->idThe text was updated successfully, but these errors were encountered: