summaryrefslogtreecommitdiff
path: root/pkg
AgeCommit message (Collapse)Author
2021-07-08maxLen for the binary heaps should be more than 0Valery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-08Add pipeline and job plugin options...Valery Piashchynski
Skeleton for the amqp plugin. Add Timeout and Pipeline to the job.Context() method. Implement queue limits for the ephemeral driver with main priority queue limits. Update configuration, add pipeline_size for every pipeline and jobs priority queue size. Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-08Unlock binary heaps max length in the consume-rate testValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-08Add length limiter for the binary heaps data structure. After max lengthValery Piashchynski
reached, insert operation will be blocked until all pending messages have been fully consumed. Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-07New Methods in the binary heap interface...Valery Piashchynski
Add Len() method to the Binary Heaps interface with implementation. Start consumers only for the user-defined set from the config. Add Headers field to the proto Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-07Updated ephemeral plugin, PQ and protobuf...Valery Piashchynski
Implement core of the root jobs plugin with a proper drivers/pipelines handling mechanism. Add delayed jobs for the ephemeral plugin. Remove ResumeAll, Resume, StopAll, Stop. Replaced with Pause/Resume with a slice of the pipelines. Other small improvements. Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-06Update Jobs interface...Valery Piashchynski
Use bh.len everywhere in the binary heaps algo instead of direct len check. Add Ack/Nack to the main jobs loop. Add PushBatch method to the jobs rpc layer. Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-06Rework ephemeral and binary heapsValery Piashchynski
Implemented a sync.Cond for binary heap algo to save processor from spinning in the for loop and receiving nil Items until the Queue will be filled. Add num_pollers option to the configuration to specify number of pollers from the queue. Add Resume, ResumeAll, Stop, StopAll, PushBatch methods to the ephemeral. Remove map and use sync.Map in the ephemeral broker. Add protobuf schema. Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-05- Update PQValery Piashchynski
- Update ephemeral plugin, complete Push - Add Jobs full configuration Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-05- Update PQ testsValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-05- Finish binary_heapValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-07-03- Initial binary_heapValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-30- Remove unused methods from the QueueImplValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-30- Update arch diagramsValery Piashchynski
- Update ephemeral plugin Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-26- Merge master branchValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-26Merge remote-tracking branch 'origin/master' into feature/jobs_pluginValery Piashchynski
2021-06-26- Add more testsValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-26- Better channel handlingValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-25- Fix bug with an exec_ttl reallocation issueValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-25- Update jobs interfaceValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-23- Add PQ (priority_queue) mockValery Piashchynski
- Add binary heap mock - Connect first sub-plugin (ephemeral) with root jobs plugin Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-23- Swithc from value to pointer to the pool configuration. InterfaceValery Piashchynski
value changed. Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-22- Move common interfaces and structures to the 'common' folderValery Piashchynski
- Update tests Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-21- Rework dispatcher, pipeline, job (not completely)Valery Piashchynski
Create a config sample with RR2 support. Progress on root JOBS plugin. Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-20- Update redis/memory pubsubsValery Piashchynski
- Rework internal message bus - Add new tests for the broadcast plugin and include them into the GA Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-18- Rework finishedValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-18- Rework main partsValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-17- Initial broadcast commitValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-14- Rework redis with ws pluginsValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-13- Optimize sync_worker payload execValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-11Remove redundant frame to byte castingValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-09- Switch to the new goridge v3.1 which supports PROTOBUFValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-08- Add protobuf versioningValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-08- Switch from the flatbuffers to the protobufValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-08- Make listener push async in the worker_handlerValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-07- Add metrics exporter for the workersValery Piashchynski
- Add metrics for the request duration and request count - Add tests Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-05- Remove incorrect test with racesValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-05- Add Windows github actionsValery Piashchynski
- Update tests, fix Windows issues Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-05- Websockets bug fixing and polishingValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-03- Add internal_error_code optionValery Piashchynski
- Update tests Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-03- Do not write an error into the responseWriter if this is internalValery Piashchynski
error - Handle SoftJob error Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-02- Remove redundand binary marshaler for the flatbuffersValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-02- Switch from the json to flatbuffersValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-06-01- Initial commitValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-05-31- Rework access_validatorsValery Piashchynski
- WS plugin uses it's own pool to handle requests on the /ws (or any user-defined) endpoint - Ability to write custom validators Signed-off-by: Valery Piashchynski <[email protected]>
2021-05-29- Add new internal plugin - channel. Which used to deliver messages fromValery Piashchynski
the ws plugin to the http directly Signed-off-by: Valery Piashchynski <[email protected]>
2021-05-28- Tests for the ws-redis, ws-memoryValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-05-28- Add more tests for the BST storageValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-05-27- Linters warnings fixValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
2021-05-27- Tests for the BST algoValery Piashchynski
Signed-off-by: Valery Piashchynski <[email protected]>
generated by cgit v1.2.3 (git 2.25.1) at 2025-01-31 03:07:24 +0000