Marmelator/pyinfra
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 36 Wiki Activity
116 Commits 9 Branches 411 Tags
Commit Graph

116 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Matthias Bisping
77f23a2185 data nesting harmonized for 1 -> 1 and 1 -> n; pdf page extraction (1 -> n) working for non-batched usage 2022-04-29 17:22:54 +02:00
Matthias Bisping
3172a00aaa refactoring 2022-04-29 17:08:34 +02:00
Matthias Bisping
501f0bd5fc signature harminization for 1 -> 1 and 1 -> n WIP: batched and not batched working again 2022-04-29 16:46:25 +02:00
Matthias Bisping
fd57261631 signature harminization for 1 -> 1 and 1 -> n WIP 2022-04-29 15:43:20 +02:00
Matthias Bisping
23070f3480 changed operation signature to return iterables for 1 -> n compatibility 2022-04-29 13:34:27 +02:00
Matthias Bisping
2550a0eff2 refactoring 2022-04-29 12:34:54 +02:00
Matthias Bisping
f053a072d6 signatures for services updated 2022-04-29 12:01:13 +02:00
Matthias Bisping
00276dbcc7 added batching wrapper for internally batching functions 2022-04-29 10:35:55 +02:00
Matthias Bisping
bc0e9ed643 renaming 2022-04-29 09:51:41 +02:00
Matthias Bisping
940bc3a689 changed buffering function behaviour: applies function to buffer. function needs to be lifted from the outside if single items are to be processed. 2022-04-28 21:58:38 +02:00
Matthias Bisping
a999ce2c3b refactoring 2022-04-28 21:36:42 +02:00
Matthias Bisping
e8315ffea9 signature of process_fn changed. Now returns {'data': ..., 'metadata'} instead of {'data': ...} 2022-04-28 21:12:25 +02:00
Matthias Bisping
087b5af929 refactoring 2022-04-28 18:28:35 +02:00
Matthias Bisping
f47d458217 send json instead of data 2022-04-28 18:05:07 +02:00
Matthias Bisping
0d503d1c1d refactoring 2022-04-28 14:30:50 +02:00
Matthias Bisping
3b0d0868b9 refactoring: method dispatch via peekable rather than special empty data request 2022-04-28 13:01:01 +02:00
Matthias Bisping
da84ff5112 buffer size constrained by assertion 2022-04-27 18:45:14 +02:00
Matthias Bisping
c9f26000d7 test parametrization for number of input items and buffer size 2022-04-27 18:38:43 +02:00
Matthias Bisping
67c4bac4b7 sync 2022-04-27 17:45:48 +02:00
Matthias Bisping
ab5839a126 refactoring; extended partial posting by image payload data 2022-04-27 16:29:52 +02:00
Matthias Bisping
fa4e5e5e0e refactoring; made test dynamic relative to import 2022-04-27 14:15:52 +02:00
Matthias Bisping
e58addf8c4 refactoring 2022-04-27 14:09:18 +02:00
Matthias Bisping
00e21b00ba refactoring 2022-04-27 14:02:41 +02:00
Matthias Bisping
fabc78efce refactoring; formatting 2022-04-27 13:41:48 +02:00
Matthias Bisping
90af62ed2c refactoring 2022-04-27 13:38:55 +02:00
Matthias Bisping
2af648254e formatting 2022-04-27 10:13:46 +02:00
Matthias Bisping
9e8172427c refactoring 2022-04-27 10:08:57 +02:00
Matthias Bisping
e903c69a07 refactoring 2022-04-27 09:13:19 +02:00
Matthias Bisping
7419612c21 partial request by manual receiver buffering V1 2022-04-26 19:54:37 +02:00
Julius Unverfehrt
656bc7cd63 explore partial responses 2022-04-26 16:34:58 +02:00
Julius Unverfehrt
f6ca9c9ac5 explore partial responses 2022-04-26 16:17:50 +02:00
Matthias Bisping
5a948ef7ad partial response test WIP 2022-04-26 16:15:54 +02:00
Matthias Bisping
4078b3e4ec signatures for services 2022-04-26 14:37:12 +02:00
Matthias Bisping
b7882d4452 refactoring: introduced sub-conftest files 2022-04-26 13:13:26 +02:00
Matthias Bisping
01daa634ec refactoring: made docker-compose api call non-autousing 2022-04-26 13:01:15 +02:00
Matthias Bisping
64624a3fd3 refactoring: moved conftest up a dir 2022-04-26 12:52:24 +02:00
Matthias Bisping
afd67d87a6 updated test container dockerfile for new location of tests directory partial_responses_3 2022-04-26 12:48:15 +02:00
Matthias Bisping
37881da08e restructuring: moved test out of module scope 2022-04-26 12:45:12 +02:00
Matthias Bisping
3d21529e43 Pull request #31: added test for sending pdf plus metadata in the same request as one json dict 
Merge in RR/pyinfra from request_as_json_rather_than_data to master

Squashed commit of the following:

commit 6301e00be6d4d76b82b4c153f22271bb3367d3ac
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Fri Apr 22 17:02:02 2022 +0200

    added test for sending pdf plus metadata in the same request as one json dict
master_51 		2022-04-26 12:36:59 +02:00
Matthias Bisping
535be0413d Pull request #30: Multiple consumers fix 
Merge in RR/pyinfra from multiple_consumer_fix to master

Squashed commit of the following:

commit b2892d2f21c90e4ebc9a48718ab0a834bf65fc32
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Apr 21 17:38:11 2022 +0200

    formatting

commit 57b3be627caf3c6a87ec248036b7258e9063709d
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Apr 21 17:36:05 2022 +0200

    removed debug print

commit 41db74b9103b55fd6f6d79b27a654042f86c86ea
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Apr 21 17:35:05 2022 +0200

    reintroduced usage for basic_consume. Normal consume was blocking other consumers, but basic_consume is not easily testable.
1.0.3 		2022-04-21 17:45:14 +02:00
Matthias Bisping
20c520aa17 fixed env var parser 1.0.2 master_47 multiple_consumer_fix_2 2022-04-21 16:02:43 +02:00
Kresnadi Budisantoso
1363030b95 Pull request #27: Add parser for bucket/container env vars 
Merge in RR/pyinfra from kbudisantoso/configyaml-1650538128334 to master

Squashed commit of the following:

commit 6103b7720315aaef3d98aea8f3c817477bbf500b
Merge: 69ac65a 3b91185
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Apr 21 14:45:10 2022 +0200

    Merge remote-tracking branch 'origin' into kbudisantoso/configyaml-1650538128334

commit 69ac65ae1bd4095c797112c6f9530f0b1705277e
Merge: 9a1cd07 a00ceae
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Apr 21 14:37:34 2022 +0200

    Merge remote-tracking branch 'origin' into kbudisantoso/configyaml-1650538128334

commit 9a1cd07c09e5ee2618f2c1a3c27b69c67b1eaeb0
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Apr 21 14:35:49 2022 +0200

    test done

commit e7127e8af937fe067f1f92eb688187ebbe609478
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Apr 21 14:32:25 2022 +0200

    test

commit 262957e33d19dbafb3f10b5a32c438460b966a88
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Thu Apr 21 14:16:33 2022 +0200

    add parser for env var storage_buckets/containers

commit 3535002b4aac9f297bdbe112b04f537cef25f5c2
Author: Kresnadi Budisantoso <kresnadi.budisantoso@iqser.com>
Date:   Thu Apr 21 12:48:52 2022 +0200

    config.yaml online editiert mit Bitbucket
1.0.1 master_45 		2022-04-21 14:55:01 +02:00
Matthias Bisping
3b91185b4d Pull request #29: refactoring; cleanup 
Merge in RR/pyinfra from sonarscan_refac to master

* commit '4009de5d3796293881ceee0a90476a038e44dbbd':
  refactoring; cleanup
master_44 		2022-04-21 14:44:35 +02:00
Matthias Bisping
4009de5d37 Merge branch 'master' of ssh://git.iqser.com:2222/rr/pyinfra into sonarscan_refac sonarscan_refac_3 2022-04-21 14:38:58 +02:00
Matthias Bisping
a00ceae0e5 Pull request #28: Prefetch adjustment 
Merge in RR/pyinfra from prefetch_adjustment to master

Squashed commit of the following:

commit 6f9d75bf49ad196bf5728386527499025ac27b3a
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Apr 21 13:47:40 2022 +0200

    removed tests without much value that caused teardown problems with docker containers

commit b7ccbe20e3babbf1127ea5738a1d710d8029c90b
Merge: 51a459c 5925737
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Apr 21 13:04:34 2022 +0200

    Merge branch 'sonarscan_refac' into prefetch_adjustment

commit 51a459cbf04e9884cf6b7c2c3145206ecf1a0ffb
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Apr 21 13:03:48 2022 +0200

    set prefetch count to 1; removed obsolete imports

commit 592573793cdfd098012a98cfc7ab0cc1fbfd0e44
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Tue Apr 19 18:01:46 2022 +0200

    refactoring; cleanup
master_43 		2022-04-21 14:01:49 +02:00
Matthias Bisping
592573793c refactoring; cleanup sonarscan_refac_2 2022-04-19 18:01:52 +02:00
Matthias Bisping
c933f66a4b Pull request #26: Config impl changes 
Merge in RR/pyinfra from config_impl_changes to master

Squashed commit of the following:

commit aa732ba18c49edf70198d9bd335193c3509f8e18
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Tue Apr 19 16:45:09 2022 +0200

    test bash script simplified

commit d70c5e48ecfde164f5e508488125c6aa9cd8e621
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Tue Apr 19 16:39:53 2022 +0200

    config coverage
master_41 prefetch_adjustment_2 		2022-04-19 16:55:34 +02:00
Matthias Bisping
1147a5dc33 Pull request #23: tests are now run in a container 
Merge in RR/pyinfra from containerized_tests to master

Squashed commit of the following:

commit 63f016a7f76af9c91602cf958639ad7fd9b4e832
Merge: 3b399ca 11c9f8a
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 15:07:25 2022 +0100

    Merge branch 'master' into containerized_tests

commit 3b399ca873c1625cde5a34c3b34fd11653af36e4
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 15:03:32 2022 +0100

    removed obsolete log

commit f854695fc22a9853449a1377d5285cc0cd60caf8
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 15:01:22 2022 +0100

    refactoring of imports

commit 72b5c597aa3e5b8ce7c16fb1abeaca8e48015597
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 15:00:37 2022 +0100

    removed obsolete code

commit ee9b0117f6c86fc23be9316b2c3690773c914e79
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:59:42 2022 +0100

    removed obsolete code

commit 020cad6e5b7cdb8e2ad867f5bcc51d5114b281f4
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:54:09 2022 +0100

    undo debug intentional crash

commit 65b77cffd319bc5230ead26391dc6b841ad8e12e
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:51:46 2022 +0100

    debug intentional crash

commit 06133189bc6ecafd0c5a9bc74b8c08b9c097a321
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:49:03 2022 +0100

    fixed syntax error in sconarscan

commit 7468c0738fe7ddabf72baaa07e7422a23c2a6f00
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:43:43 2022 +0100

    failing sonar job if coverage.xml not present as proxcy for failed tests

commit ebcee7ff2a53c643efb64b835f99640567da224b
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:36:34 2022 +0100

    simplified copying of coverage.xml and removing of testcontainer

commit 1fb24d67f10aebe2747b76a4990a3c9fe2c0b00b
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:18:30 2022 +0100

    RABBITMQ_DISK_FREE_ABSOLUTE_LIMIT=20Gi

commit 07873d607097308c5371029a74e115895266d30c
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:12:51 2022 +0100

    RABBITMQ_DISK_FREE_RELATIVE_LIMIT=5%

commit d8eb294fb18c5b0b2418d8a397ef66ef133081bf
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:11:00 2022 +0100

    RABBITMQ_DISK_FREE_RELATIVE_LIMIT=100%

commit f9010ed998f2a5da3940ad3f0d8a2a8cff209b0d
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 14:04:35 2022 +0100

    RABBITMQ_VM_MEMORY_HIGH_WATERMARK=100%

commit 41e9f8046aae66fc9a7248b7c6194fe7e9e9c814
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 13:42:34 2022 +0100

    RABBITMQ_VM_MEMORY_HIGH_WATERMARK=0

commit 301ba05d66452cf5b85511527a35582cd1396803
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 13:19:10 2022 +0100

    set AMPQ heartbeat

commit 9f4dfb9781847bed6077d49e931719c04460e88c
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 10:42:21 2022 +0100

    channel and connection closing experimenting

commit e3812725acff1df2a26e337dbc88df11cd6b8b22
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 10:12:15 2022 +0100

    pika tearndown adjusted

commit 0206be86669c9f4b70bb21d416d6f10ce5e8731a
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 09:58:18 2022 +0100

    return instead of yield in Consumer.consume

commit 17e11adf7822916dd3ece201529796e4dfd89032
Author: Matthias Bisping <matthias.bisping@iqser.com>
Date:   Thu Mar 24 09:51:52 2022 +0100

    processing log added to test

... and 26 more commits
master_40 test_coverage_2 		2022-03-24 15:32:34 +01:00
Julius Unverfehrt
11c9f8a073 Pull request #25: Fixes 
Merge in RR/pyinfra from fixes to master

Squashed commit of the following:

commit e3eff12ccdea52e041cc7a14cda72d3e32aa2144
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 22 15:42:35 2022 +0100

    black

commit 2bc520c849ea4e833cb60b2c97626da6636d3155
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 22 15:42:08 2022 +0100

    adjust mock script

commit 429b6b8f3a3fc8aa35515395712057d1c7bec13e
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 22 15:41:42 2022 +0100

    change scope for retry consume

commit 7488394e313270fe7ba356c40d810e7cb3c706ee
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 22 15:39:39 2022 +0100

    add heartbeat to AMQP connection

commit 004c5fa805bfb982f55de533bc109fa21bacfbc8
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Tue Mar 22 15:38:15 2022 +0100

    Adjust error handling for missing prometheus endpoint: error is logged not raised
1.0.0 master_37 		2022-03-22 15:48:27 +01:00
Julius Unverfehrt
1b1da50faf Pull request #24: Response dict & Prometheus forwarding 
Merge in RR/pyinfra from response-dict to master

Squashed commit of the following:

commit aed09653aafe7b9558c542ea0c36a5f072c6ab9e
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Mon Mar 21 15:20:24 2022 +0100

    BLACK

commit d1b76673a22373c32815466c37dcb006fa0d6fb4
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Mon Mar 21 15:19:55 2022 +0100

    change default response dict

commit 82bd48a7545b9b244bdcdebf7ce976947eecf580
Author: Julius Unverfehrt <julius.unverfehrt@iqser.com>
Date:   Mon Mar 21 15:19:15 2022 +0100

    fix handling of missing prometheus endpoint
0.1.9 master_35 		2022-03-21 15:22:38 +01:00