[PATCH] doc: elaborate on per test suite configuration dts docs

2025-05-16 Thread Nicholas Pratte
Introduce some additional documentation explaing the per test suite configuration component of DTS as the current dts documentation does not provide a quick access reference guide or explanation. Signed-off-by: Nicholas Pratte --- doc/guides/tools/dts.rst | 22 ++ 1 file

[RFC v2 6/6] dts: add performance test functions to test suite api

2025-05-16 Thread Nicholas Pratte
Provide functional performance method to run performance tests using a user-supplied performance traffic generator. The single core performance test is included, with some basic statistics checks verifying TG packet transmission rates. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts

[RFC v2 5/6] dts: add trex traffic generator to dts framework

2025-05-16 Thread Nicholas Pratte
mance traffic generator in addition to a functional traffic generator. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/framework/config/test_run.py | 20 +- dts/framework/context.py | 11 +- dts/framework/test_run.py | 27 +- dts/fram

[RFC v2 4/6] dts: add extended timeout option to interactive shells.

2025-05-16 Thread Nicholas Pratte
stdin commands may require an explicit duration of time to facilitate a total execution. Add an extra parameter to interactive shells to handle these circumstances. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/interactive_shell.py | 9 - 1 file

[RFC v2 3/6] dts: add asynchronous support to ssh sessions.

2025-05-16 Thread Nicholas Pratte
avoided. This functionality leverages Fabric's Promise class, which provides a join method to terminate the process when the process is done being used, providing more secure process control. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/ssh_session.py

[RFC v2 2/6] dts: rework traffic generator inheritance structure.

2025-05-16 Thread Nicholas Pratte
Rework TG class hierarchy to include performance traffic generators, in addition to capturing traffic generators. As such, methods garnered to capturing traffic have been moved to the CapturingTrafficGenerator subclass. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte

[RFC v2 1/6] dts: rework config module to support perf TGs

2025-05-16 Thread Nicholas Pratte
. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/{ => configurations}/nodes.example.yaml| 0 dts/{ => configurations}/test_run.example.yaml | 8 +++- .../tests_config.example.yaml | 0 dts/configurations/trex_configs/intel_40g.yam

[RFC v2 0/6] Add TREX Traffic Generator to DTS Framework

2025-05-16 Thread Nicholas Pratte
v2: * Still some formatting issues that need clean up. * Several issues have been addressed - Includes some of Patrick's comments. - Personally identified bug fixes. * Single core perf test has been fleshed out. Nicholas Pratte (6): dts: rework config module to support per

Re: [RFC Patch v1 4/5] dts: add trex traffic generator to dts framework

2025-05-16 Thread Nicholas Pratte
>> Implement the TREX traffic generator for use in the DTS framework. The >> provided implementation leverages TREX's stateless API automation >> library, via use of a Python shell. As such, version control of TREX may >> be needed. The DTS context has been modified to include a performance >> traf

Re: [RFC Patch v1 2/5] dts: rework traffic generator inheritance structure.

2025-05-16 Thread Nicholas Pratte
Hi Patick, see below! >> + >> +from framework.testbed_model.traffic_generator.traffic_generator import >> TrafficGenerator > > > I think this can become: > > from .traffic_generator import TrafficGenerator Ack. > >> >> + >> + >> +@dataclass(slots=True) >> +class PerformanceTrafficStats(ABC): >>

Re: [PATCH v1 4/4] change verification field in unified packet suite

2025-05-14 Thread Nicholas Pratte
Looks good! Reviewed-by: Nicholas Pratte On Thu, Mar 6, 2025 at 4:47 PM Dean Marx wrote: > > Changes the unified packet testing suite to use layer 4 > destination ports as packet verification IDs. > > Signed-off-by: Dean Marx > --- > dts/tests/TestS

Re: [PATCH v1 3/4] dts: remove unnecessary capability requirement

2025-05-14 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Thu, Mar 6, 2025 at 4:47 PM Dean Marx wrote: > > Remove capability requirement from checksum offload test suite > that was not required to run the test cases. > > Signed-off-by: Dean Marx > --- > dts/tests/TestSuite_checksum_offload.py |

Re: [PATCH v1 2/4] dts: change verification field in checksum offload suite

2025-05-14 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Thu, Mar 6, 2025 at 4:47 PM Dean Marx wrote: > > Changes the checksum offload testing suite to use layer 4 > destination ports as packet verification IDs. > > Signed-off-by: Dean Marx > --- > dts/tests/TestSuite_chec

Re: [PATCH v1 1/4] dts: add layer 4 port field to verbose parser

2025-05-14 Thread Nicholas Pratte
Makes sense to me! Reviewed-by: Nicholas Pratte On Thu, Mar 6, 2025 at 4:47 PM Dean Marx wrote: > > Add a field to the TestPmdVerbosePacket text parser > that stores destination port values for TCP/UDP packets. > > Signed-off-by: Dean Marx > --- > dts/fra

Re: [PATCH v2 6/7] dts: remove multi-inheritance classes

2025-04-25 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Mar 14, 2025 at 9:19 AM Luca Vizzarro wrote: > > Multi inheritance has proven to be flaky in Python, therefore revert > back to a simpler approach where classes will only inherit one base > class. As part of this change, instead o

Re: [PATCH v2 7/7] dts: enable shell pooling

2025-04-25 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Mar 14, 2025 at 9:19 AM Luca Vizzarro wrote: > > Enable the ShellPool class to be used in the test run, and let > InteractiveShells register themselves to the pool upon shell startup. > Moreover, to avoid the ShellPool to call InteractiveShel

Re: [PATCH v2 5/7] dts: make shells path dynamic

2025-04-25 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Mar 14, 2025 at 9:19 AM Luca Vizzarro wrote: > > Turn the `path` attribute of InteractiveShell into a method property. > This allows path to both be defined statically by the class > implementation and also to be defined dynamically as part

Re: [PATCH v2 4/7] dts: revert back to a single InteractiveShell

2025-04-25 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Mar 14, 2025 at 9:19 AM Luca Vizzarro wrote: > > Previously InteractiveShell was split into two classes to differentiate > a shell which execution must be controlled in a tight scope through a > context manager, from a more looser approach. With

Re: [PATCH v2 1/7] dts: escape single quotes

2025-04-25 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Mar 14, 2025 at 9:19 AM Luca Vizzarro wrote: > > When making any command a privileged one in a LinuxSession, there > currently is no consideration whether this command already includes single > quotes. Therefore escape the existing single q

Re: [PATCH v2 2/7] dts: add blocking dpdk app class

2025-04-25 Thread Nicholas Pratte
This is perfect for my TREX implementation! Reviewed-by: Nicholas Pratte On Fri, Mar 14, 2025 at 9:19 AM Luca Vizzarro wrote: > > Add BlockingDPDKApp class. Some non-interactive applications are > blocking and run until the user interrupts them. As their main intended > usage i

[RFC Patch v1 3/5] dts: add asychronous support to ssh sessions.

2025-04-23 Thread Nicholas Pratte
avoided. This functionality leverages Fabric's Promise class, which provides a join method to terminate the process when the process is done being used, providing more secure process control. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/ssh_session.py

[RFC Patch v1 5/5] dts: add performance test functions to test suite api

2025-04-23 Thread Nicholas Pratte
Provide functional performance method to run performance tests using a user-supplied performance traffic generator. The single core performance test is included, with some basic statistics checks verifying TG packet transmission rates. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts

[RFC Patch v1 4/5] dts: add trex traffic generator to dts framework

2025-04-23 Thread Nicholas Pratte
rator in addition to a functional traffic generator. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/framework/config/test_run.py | 20 +- dts/framework/context.py | 11 +- dts/framework/test_run.py | 28 +- dts/framework/test_sui

[RFC Patch v1 1/5] dts: rework config module to support perf TGs

2025-04-23 Thread Nicholas Pratte
. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte --- dts/{ => configurations}/nodes.example.yaml| 0 dts/{ => configurations}/test_run.example.yaml | 8 +++- .../tests_config.example.yaml | 0 dts/configurations/trex_configs/intel_40g.yam

[RFC Patch v1 2/5] dts: rework traffic generator inheritance structure.

2025-04-23 Thread Nicholas Pratte
Rework TG class hierarchy to include performance traffic generators, in addition to capturing traffic generators. As such, methods garnered to capturing traffic have been moved to the CapturingTrafficGenerator subclass. Bugzilla ID: 1697 Signed-off-by: Nicholas Pratte

[RFC Patch v1 0/5] Add TREX Traffic Generator to DTS Framework

2025-04-23 Thread Nicholas Pratte
, but does execute without errors on my system. Nicholas Pratte (5): dts: rework config module to support perf TGs dts: rework traffic generator inheritance structure. dts: add asychronous support to ssh sessions. dts: add trex traffic generator to dts framework dts: add performance test

Re: [PATCH v2 7/7] dts: remove node distinction

2025-02-14 Thread Nicholas Pratte
Right off the bat, I like this organization a lot more. Definitely a lot easier to navigate the code. Reviewed-by: Nicholas Pratte On Wed, Feb 12, 2025 at 11:46 AM Luca Vizzarro wrote: > > Remove the distinction between SUT and TG nodes for configuration > purposes. As DPDK and th

Re: [PATCH v2 6/7] dts: revamp runtime internals

2025-02-14 Thread Nicholas Pratte
This definitely cleans things up a lot! Reviewed-by: Nicholas Pratte > @@ -217,9 +218,7 @@ def get_supported_capabilities( > ) > if cls.capabilities_to_check: > capabilities_to_check_map = cls._get_decorated_capabilities_map() > -wi

Re: [PATCH v2 5/7] dts: add global runtime context

2025-02-12 Thread Nicholas Pratte
Definitely much easier to read, in a general sense, with these changes. Reviewed-by: Nicholas Pratte On Wed, Feb 12, 2025 at 11:46 AM Luca Vizzarro wrote: > > Add a new context module which holds the runtime context. The new > context will describe the current scenario and aid u

Re: [RFC PATCH 5/7] dts: add runtime status

2025-02-12 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Feb 3, 2025 at 10:17 AM Luca Vizzarro wrote: > > Add a new module which defines the global runtime status of DTS and the > distinct execution stages and steps. > > Signed-off-by: Luca Vizzarro > --- > doc/api/dts/framework.status.rst

Re: [RFC PATCH 3/7] dts: revamp Topology model

2025-02-10 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Feb 3, 2025 at 10:17 AM Luca Vizzarro wrote: > > Change the Topology model to add further flexility in its usage as a > standalone entry point to test suites. > > Signed-off-by: Luca Vizzarro > --- > dts/framework/testbed_m

Re: [RFC PATCH 2/7] dts: isolate test specification to config

2025-02-10 Thread Nicholas Pratte
This makes sense to me! Reviewed-by: Nicholas Pratte On Mon, Feb 3, 2025 at 10:17 AM Luca Vizzarro wrote: > > In an effort to improve separation of concerns, make the TestRunConfig > class responsible for processing the configured test suites. Moreover, > give TestSuiteConfig a

Re: [RFC PATCH 1/7] dts: add port topology configuration

2025-02-07 Thread Nicholas Pratte
Hi Luca, nice work! See comments below. > > > +class LinkPortIdentifier(NamedTuple): > +"""A tuple linking test run node type to port name.""" > + > +node_type: Literal["sut", "tg"] > +port_name: str > + > + > +class PortLinkConfig(FrozenModel): > +"""A link between the ports of t

Re: [PATCH v2 2/2] dts: rework run-time MTU adjustment test case

2025-02-05 Thread Nicholas Pratte
My bad! I'll fix that real quick. On Mon, Feb 3, 2025 at 11:51 AM Luca Vizzarro wrote: > > On 03/02/2025 16:38, Nicholas Pratte wrote: > > --- a/dts/tests/TestSuite_mtu.py > > +++ b/dts/tests/TestSuite_mtu.py > > @@ -164,22 +164,33 @@ def test_runtime_mtu

[PATCH v2 2/2] dts: rework run-time MTU adjustment test case

2025-02-03 Thread Nicholas Pratte
Forwarding restarts in the run-time MTU adjustment test case have been explicitly added, given that the 'requires_forwarding_restart' decorator from a previous patch was removed. Signed-off-by: Nicholas Pratte --- dts/tests/TestSuite_mtu.py | 13 - 1 file changed, 12

[PATCH v2 1/2] dts: remove 'requires_forwarding_restart' from framework

2025-02-03 Thread Nicholas Pratte
This implementation conflicts with other bug fixes implemented in earlier patches. The decorator was devised as a mean to make suite writing a bit simpler, semantically, but the addition of this adds too many complications for it to be worth implementing. Signed-off-by: Nicholas Pratte --- dts

[PATCH v2 0/2] remove requires forwarding restart from framework

2025-02-03 Thread Nicholas Pratte
out this issue and its potential side-effects. Nicholas Pratte (2): dts: remove 'requires_forwarding_restart' from framework dts: rework run-time MTU adjustment test case dts/framework/remote_session/testpmd_shell.py | 26 +-- dts/tests/TestSu

Re: [PATCH 2/2] dts: rework run-time MTU adjustment test case

2025-02-03 Thread Nicholas Pratte
> > The start and stop could be grouped by forwarding sections: > >set_mtu() > >start() >assess() >assess() >stop() > >set_mtu() >... Alright, I'll fix that real quick!

[PATCH 0/2] remove 'requires_forwarding_restart' from framework

2025-01-31 Thread Nicholas Pratte
time implementing this. Arguably, it also makes sense to have these mechanics (such as forwarding restarts) written explicitly within the test suites. Thank you Luca for pointing out this issue and its potential side-effects. Nicholas Pratte (2): dts: remove 'requires_forwarding_restart&

[PATCH 1/2] dts: remove 'requires_forwarding_restart' from framework

2025-01-31 Thread Nicholas Pratte
This implementation conflicts with other bug fixes implemented in earlier patches. The decorator was devised as a mean to make suite writing a bit simpler, semantically, but the addition of this adds too many complications for it to be worth implementing. Signed-off-by: Nicholas Pratte --- dts

[PATCH 2/2] dts: rework run-time MTU adjustment test case

2025-01-31 Thread Nicholas Pratte
Forwarding restarts in the run-time MTU adjustment test case have been explicitly added, given that the 'requires_forwarding_restart' decorator from a previous patch was removed. Signed-off-by: Nicholas Pratte --- dts/tests/TestSuite_mtu.py | 8 +++- 1 file changed, 7 insert

[PATCH v2 1/2] dts: add fwd restart decorator to rx capabilities

2025-01-24 Thread Nicholas Pratte
for cleaner, easier to read code. Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/testpmd_shell.py | 26 ++- 1 file changed, 25 insertions(+), 1 deletion(-) diff --git a/dts/framework/remote_session/testpmd_shell.py b/dts/framework/remote_session/testpmd_shell.py

[PATCH v2 0/2] dts: mtu update and jumbo frames test suite

2025-01-24 Thread Nicholas Pratte
insightful. inbox.dpdk.org/dev/0f4866fc-b76d-cf83-75e8-86326c028...@intel.com/ inbox.dpdk.org/dev/20211018134854.1258938-5-ferruh.yi...@intel.com/ inbox.dpdk.org/dev/e2554b78-cdda-aa33-ac6d-59a543a10...@intel.com/ Nicholas Pratte (2): dts: add fwd restart decorator to rx capabilities dts: add mtu

[PATCH v2 2/2] dts: add mtu update and jumbo frames test suite

2025-01-24 Thread Nicholas Pratte
tment options within the ethdev api. Bugzilla ID: 1421 Signed-off-by: Nicholas Pratte Signed-off-by: Alex Chapman --- dts/tests/TestSuite_mtu_update_fwding.py | 278 +++ 1 file changed, 278 insertions(+) create mode 100644 dts/tests/TestSuite_mtu_update_fwding.py di

Re: [PATCH v1 2/2] dts: add mtu update and jumbo frames test suite

2025-01-24 Thread Nicholas Pratte
Thank you for the feedback, see my comments below! >> +current_mtu = testpmd_shell.show_port_info(0).mtu >> +self.verify(current_mtu is not None, "Error grabbing testpmd MTU >> value.") >> +if current_mtu and ( >> +current_mtu >= STANDARD_MTU + VENDOR_AGNOSTIC

Re: [PATCH v1 1/2] dts: add fwd restart decorator to rx capabilities

2025-01-24 Thread Nicholas Pratte
14 PM Patrick Robb wrote: > > > > On Fri, Jan 17, 2025 at 9:58 AM Nicholas Pratte wrote: >> >> -@requires_started_ports >> >> +@requires_forwarding_restart >> @requires_stopped_ports >> def set_port_mtu(self, port_id: int, mtu: int, ve

Re: [PATCH v4 0/7] dts: refactor configuration

2025-01-24 Thread Nicholas Pratte
e > - added new comment in the configuration example file to indicate > that all test suites are run if none are specified > > Luca Vizzarro (3): > dts: handle CLI overrides in the configuration > dts: split configuration file > dts: run all test suites by default > >

Re: [PATCH v4 4/7] dts: rework DPDK attributes in SUT node config

2025-01-24 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > Rework 'lcores' and 'memory_channels' into a new 'dpdk_config' > subsection in an effort to make these attributes SUT specific; the >

Re: [PATCH v4 7/7] dts: run all test suites by default

2025-01-24 Thread Nicholas Pratte
Nice touch! Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM Luca Vizzarro wrote: > > The configuration requires the user to explicitly set the requested test > suites in the files. Sometimes we want to run all the test suites and > don't want to manually specify a

Re: [PATCH v4 6/7] dts: split configuration file

2025-01-24 Thread Nicholas Pratte
This is great! Before Jeremy left, he suggested going a step further and putting the config in a directory of its own, potentially offering more flexibility. Something we could consider looking into in the future, if there is time. Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM

Re: [PATCH v4 5/7] dts: handle CLI overrides in the configuration

2025-01-24 Thread Nicholas Pratte
Thank you for addressing this. Great work! Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM Luca Vizzarro wrote: > > The current handling of the configuration loading is inconsistent. After > the whole configuration is loaded, if there are any CLI or environment > o

Re: [PATCH v4 3/7] dts: infer use first core without config

2025-01-24 Thread Nicholas Pratte
n any case, it doesn't hurt to keep this patch in the series. Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > To further the simplification of the user configuration, use_first_core > can be inferred from the

Re: [PATCH v4 2/7] dts: simplify build options config

2025-01-24 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > The build options configuration contained redundant fields that were not > in use, and there is no future scope for their use. > > Bugzilla ID: 1360 > &

Re: [PATCH v4 1/7] dts: enable arch self-discovery

2025-01-24 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Fri, Jan 24, 2025 at 6:39 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > The 'arch' attribute in the conf.yaml is unnecessary, as this can be > readily discovered directly from any given node. > > Bugzilla ID: 1360 >

Re: [PATCH v3 3/7] dts: infer use first core without config

2025-01-22 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Wed, Jan 15, 2025 at 9:19 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > To further the simplification of the user configuration, use_first_core > can be inferred from the lcores. If the user explicitly includes the > core 0 in the lco

Re: [PATCH v3 2/7] dts: simplify build options config

2025-01-22 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Wed, Jan 15, 2025 at 9:19 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > The build options configuration contained redundant fields that were not > in use, and there is no future scope for their use. > > Bugzilla ID: 1360 > &

Re: [PATCH v3 1/7] dts: enable arch self-discovery

2025-01-22 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Wed, Jan 15, 2025 at 9:19 AM Luca Vizzarro wrote: > > From: Nicholas Pratte > > The 'arch' attribute in the conf.yaml is unnecessary, as this can be > readily discovered directly from any given node. > > Bugzilla ID: 1360 >

[PATCH v1 2/2] dts: add mtu update and jumbo frames test suite

2025-01-17 Thread Nicholas Pratte
tment options within the ethdev api. Bugzilla ID: 1421 Signed-off-by: Nicholas Pratte Signed-off-by: Alex Chapman --- dts/tests/TestSuite_mtu_update_fwding.py | 278 +++ 1 file changed, 278 insertions(+) create mode 100644 dts/tests/TestSuite_mtu_update_fwding.py di

[PATCH v1 1/2] dts: add fwd restart decorator to rx capabilities

2025-01-17 Thread Nicholas Pratte
for cleaner, easier to read code. Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/testpmd_shell.py | 26 ++- 1 file changed, 25 insertions(+), 1 deletion(-) diff --git a/dts/framework/remote_session/testpmd_shell.py b/dts/framework/remote_session/testpmd_shell.py

[PATCH v1 0/2] dts: mtu update and jumbo frames test suite

2025-01-17 Thread Nicholas Pratte
.com/ inbox.dpdk.org/dev/20211018134854.1258938-5-ferruh.yi...@intel.com/ inbox.dpdk.org/dev/e2554b78-cdda-aa33-ac6d-59a543a10...@intel.com/ Nicholas Pratte (2): dts: add fwd restart decorator to rx capabilities dts: add mtu update and jumbo frames test suite dts/framework/remote_session/te

[PATCH] dts: fix hugepage configuration bug

2025-01-14 Thread Nicholas Pratte
reorientation of the code prevents this, and allows for easier error assessment. Signed-off-by: Nicholas Pratte --- dts/framework/testbed_model/linux_session.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dts/framework/testbed_model/linux_session.py b/dts/framework

Re: [PATCH] dts: fix MTU set command

2025-01-07 Thread Nicholas Pratte
Thanks Luca! Reviewed-by: Nicholas Pratte On Tue, Jan 7, 2025 at 9:13 AM Luca Vizzarro wrote: > > There are some PMDs that in order to set a scatter-offload-compatible > MTU size, they need to have started at least once since the startup of > testpmd. This fixes the behaviour of th

[PATCH v1] dts: bug fixes for paramiko timeout and buffered_pipe issues

2024-12-12 Thread Nicholas Pratte
27;stdout' buffered pipes is a result of the context manager's cleanup process. Explicit calls to close the 'stdin' buffered pipe is needless and this is done via a 'Channel.close()' within Paramiko. The following patch corrects these issues. Bugz

[PATCH v2] dts: add time delay to async sniffer callback function

2024-11-13 Thread Nicholas Pratte
, inserting a one second delay in the callback function will suffice. Bugzilla ID: 1573 Signed-off-by: Nicholas Pratte --- .../testbed_model/traffic_generator/scapy.py | 11 +++ 1 file changed, 7 insertions(+), 4 deletions(-) diff --git a/dts/framework/testbed_model

Re: [PATCH v2 2/2] dts: add blocklist test suite

2024-11-07 Thread Nicholas Pratte
Hi Luca, nice work! See my small comment below/ I ran some local tests and everything seems to be working fine, so other than that minor fix I pointed out, the rest should be all set! > +"""The DPDK device blocklisting test suite. > + > +This testing suite ensures tests the port blocklisting fun

Re: [PATCH v2 1/2] dts: add blocked ports to EalParams

2024-11-07 Thread Nicholas Pratte
Hi Luca, this looks good to me! The only thing that needs to be fixed is the attributes component of the docstring for EalParams in eal.py. Aside from that: Reviewed-by: Nicholas Pratte On Thu, Nov 7, 2024 at 9:00 AM Luca Vizzarro wrote: > > Make the "ports" attribute of

Re: [PATCH v2] dts: fix doxygen API link and DTS docs placement

2024-11-06 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte

Re: [PATCH] dts: improve statistics

2024-11-06 Thread Nicholas Pratte
Code looks good. I ran some tests on my end and did not run into the NULL test suite issue that Dean ran into. I'm guessing Dean ran into an error changing up the code because the patch file wouldn't apply. Reviewed-by: Nicholas Pratte Tested-by: Nicholas Pratte

Re: [PATCH v2] dts: fix verify argument in set forward mode

2024-11-04 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Thu, Oct 10, 2024 at 2:42 PM Dean Marx wrote: > > Fix optional verify argument in set_forward_mode > method in testpmd shell class. > > Bugzilla ID: 1410 > Fixes: fc0f7dc47ee3 ("dts: add testpmd shell params") > > Signed-off-by:

Re: [PATCH v4 8/8] dts: use TestSuiteSpec class imports

2024-11-04 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > The introduction of TestSuiteSpec adds auto-discovery of test suites, > which are also automatically imported. This causes double imports as the > runner loads the test suites. This changes the

Re: [PATCH 4/5] dts: use TestSuiteSpec class imports

2024-11-04 Thread Nicholas Pratte
Noted, I appreciate the insight! On Tue, Oct 29, 2024 at 8:56 AM Luca Vizzarro wrote: > > On 01/10/2024 21:45, Nicholas Pratte wrote: > > The code you have here makes sense, and I like the implementation as > > it removes a lot of fluff in DTSRunner. I know Jurja mentioned

Re: [PATCH v4 7/8] dts: improve configuration API docs

2024-11-04 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > Pydantic models are not treated the same way as dataclasses by autodoc. > As a consequence the docstrings need to be applied directly to each > field. Otherwise the generated API documentatio

Re: [PATCH v4 6/8] dts: add autodoc pydantic

2024-10-31 Thread Nicholas Pratte
Definitely a set in the right direction here! Just a small typo, but otherwise: Reviewed-by: Nicholas Pratte > --- a/doc/guides/tools/dts.rst > +++ b/doc/guides/tools/dts.rst > @@ -204,9 +204,10 @@ node, and then run the tests with the newly built > binaries. >

Re: [PATCH v4 2/8] dts: add TestSuiteSpec class and discovery

2024-10-31 Thread Nicholas Pratte
On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > Currently there is a lack of a definition which identifies all the test > suites available to test. This change intends to simplify the process to > discover all the test suites and idenfity them. Noticed this in the corner of my eye. 'iden

Re: [PATCH v4 5/8] dts: remove warlock dependency

2024-10-31 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > Since pydantic has completely replaced warlock, there is no more need to > keep it as a dependency. This removes it. > > Signed-off-by: Luca Vizzarro > Reviewed-by: Paul Szczepanek > -

Re: [PATCH v4 4/8] dts: use pydantic in the configuration

2024-10-31 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > This change brings in pydantic in place of warlock. Pydantic offers > a built-in model validation system in the classes, which allows for > a more resilient and simpler code. As a consequence of

Re: [PATCH v4 3/8] dts: refactor build and node info classes

2024-10-31 Thread Nicholas Pratte
It took me a second to appreciate what the goal of separating this is, but it makes complete sense to me now. This was an oversight on my end as well when I was working on the config changes in once of the patches I was assigned. Interestingly enough, I ran into a similar problem with circular depe

Re: [PATCH v4 2/8] dts: add TestSuiteSpec class and discovery

2024-10-31 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > Currently there is a lack of a definition which identifies all the test > suites available to test. This change intends to simplify the process to > discover all the test suites and idenfity them

Re: [PATCH v4 1/8] dts: add pydantic dependency

2024-10-31 Thread Nicholas Pratte
Reviewed-by: Nicholas Pratte On Mon, Oct 28, 2024 at 1:51 PM Luca Vizzarro wrote: > > As part of configuration validation and deserialization improvements, > this adds pydantic as a project dependency. Pydantic is a library that > caters to all of the aforementioned needs, while i

[PATCH v1] dts: add time delay to async sniffer callback function

2024-10-30 Thread Nicholas Pratte
, inserting a one second delay in the callback function will suffice. Bugzilla ID: 1573 Signed-off-by: Nicholas Pratte --- dts/framework/testbed_model/traffic_generator/scapy.py | 9 ++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/dts/framework/testbed_model/traffic_generator

[PATCH v9 3/3] dts: mac filter test suite refactored for new dts

2024-10-16 Thread Nicholas Pratte
igned to be vendor agnostic. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/config/conf_yaml_schema.json | 3 +- dts/tests/TestSuite_mac_filter.py | 204 + 2 files changed, 206 insertions(+), 1 deletion(-) create mode 100644 dts/

[PATCH v9 2/3] dts: add capability check for multicast filtering

2024-10-16 Thread Nicholas Pratte
The multicast address filter component of the mac filter test suite is definitively supported across all vendors. Thus, a simple capability check is added to ensure that this functionality is supported. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session

[PATCH v9 1/3] dts: add methods for setting mac and multicast addresses

2024-10-16 Thread Nicholas Pratte
based on a boolean 'add or remove' parameter. The success or failure of each call can be verified if a user deems it necessary. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/testpmd_shell.py | 59 +++ 1 file changed, 59 insertions(+) d

[PATCH v9 0/3] dts: mac filter port to new dts

2024-10-16 Thread Nicholas Pratte
v9: * Removed the vlan component of the multicast filter test as there is an ongoing bug with this functionality across many NICs. * Added a multicast address capability check since some NICs do not support this feature. Nicholas Pratte (3): dts: add methods for setting mac and

[PATCH v8 2/2] dts: mac filter test suite refactored for new dts

2024-10-10 Thread Nicholas Pratte
igned to be vendor agnostic. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- v1: * In porting over this test suite into the new framework, some adjustments were made, namely in the EAL and TestPMD parameter provided before executing the application. While the original test pla

[PATCH v8 1/2] dts: add methods for setting mac and multicast addresses

2024-10-10 Thread Nicholas Pratte
based on a boolean 'add or remove' parameter. The success or failure of each call can be verified if a user deems it necessary. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/testpmd_shell.py | 59 +++ 1 file changed, 59 insertions(+) d

[PATCH v8 0/2] dts: mac filter port to new dts

2024-10-10 Thread Nicholas Pratte
v8: * final adjustments made for the merged version of vlan testpmd methods. Nicholas Pratte (2): dts: add methods for setting mac and multicast addresses dts: mac filter test suite refactored for new dts dts/framework/config/conf_yaml_schema.json| 3 +- dts/framework

[PATCH v7 2/2] dts: mac filter test suite refactored for new dts

2024-10-10 Thread Nicholas Pratte
igned to be vendor agnostic. depends-on: patch-143594 ("dts: add send_packets to test suites and rework packet addressing") depends-on: patch-143385 ("dts: add VLAN methods to testpmd shell") Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/config/conf_yaml_

[PATCH v7 1/2] dts: add methods for setting mac and multicast addresses

2024-10-10 Thread Nicholas Pratte
based on a boolean 'add or remove' parameter. The success or failure of each call can be verified if a user deems it necessary. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/testpmd_shell.py | 59 +++ 1 file changed, 59 insertions(+) d

[PATCH v7 0/2] dts: mac filter port to new dts

2024-10-10 Thread Nicholas Pratte
v7: * adjusted commit messages to be more associative with the main branch Nicholas Pratte (2): dts: add methods for setting mac and multicast addresses dts: mac filter test suite refactored for new dts dts/framework/config/conf_yaml_schema.json| 3 +- dts/framework

[PATCH v6 2/2] dts: mac filter test suite refactored for new dts

2024-10-08 Thread Nicholas Pratte
--rxfreet=64 --mbcache=250 --portmask=0x3 depends-on: patch-143594 ("dts: add send_packets to test suites and rework packet addressing") depends-on: patch-143385 ("dts: add VLAN methods to testpmd shell") Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- v2: * Refact

[PATCH v6 1/2] dts: add methods for setting mac and multicast addresses

2024-10-08 Thread Nicholas Pratte
based on a boolean 'add or remove' parameter. The success or failure of each call can be verified if a user deems it necessary. Bugzilla ID: 1454 Signed-off-by: Nicholas Pratte --- dts/framework/remote_session/testpmd_shell.py | 59 +++ 1 file changed, 59 insertions(+) d

[PATCH v6 0/2] Mac Filter Port to New DTS

2024-10-08 Thread Nicholas Pratte
v6: * Added a subtle change to the invalid address test to avoid failures. This component should be discussed and eventually fixed as this is a temporary fix for a discovered issue. * Added decorators to sync with the capabilities patch. Nicholas Pratte (2): dts: add methods for

Re: [PATCH 5/5] dts: add JSON schema generation script

2024-10-01 Thread Nicholas Pratte
Seems straightforward. There are actually some intersections here between my currently-existing config changes and some of the trimming you provide here which simplifies my upcoming series when I rebase it to use this series. Reviewed-by: Nicholas Pratte On Thu, Aug 22, 2024 at 12:40 PM Luca

Re: [PATCH 4/5] dts: use TestSuiteSpec class imports

2024-10-01 Thread Nicholas Pratte
Maybe you could provide some insight? I'll make sure to analyse this deeper in my own time as well. Beyond that: Reviewed-by: Nicholas Pratte On Thu, Aug 22, 2024 at 12:40 PM Luca Vizzarro wrote: > > The introduction of TestSuiteSpec adds auto-discovery of test suites, > which are

Re: [PATCH 3/5] dts: use Pydantic in the configuration

2024-09-30 Thread Nicholas Pratte
Hi Luca! See my comments below, thanks! On Thu, Aug 22, 2024 at 12:40 PM Luca Vizzarro wrote: > > This change brings in Pydantic in place of Warlock. Pydantic offers > a built-in model validation system in the classes, which allows for > a more resilient and simpler code. As a consequence of this

Re: [PATCH 1/5] dts: add TestSuiteSpec class and discovery

2024-09-19 Thread Nicholas Pratte
I think Juraj's comments here make sense, it probably would make sense to separate this in-conjunction with Juraj's decorator patch and use it as a dependency. From what I can understand, the changes offered here make sense to me. Reviewed-by: Nicholas Pratte -- *Let

Re: [PATCH 2/5] dts: add Pydantic and remove Warlock

2024-09-19 Thread Nicholas Pratte
I understand Juraj's concern about the dependencies assuming this change was to stay in its own isolated patch in the log. That aside, this is pretty straightforward, and I have confidence in the judgement of whatever decision is made between the two of you. Reviewed-by: Nicholas Pratte O

Re: [PATCH v2 1/6] dts: Remove build target config and list of devices

2024-09-12 Thread Nicholas Pratte
> > @classmethod > > def from_dict(cls, d: BuildTargetConfigDict) -> Self: > > r"""A convenience method that processes the inputs before creating > > an instance. > > > > -`arch`, `os`, `cpu` and `compiler` are converted to > > :class:`Enum`\s and > > -`name` i

Re: [PATCH v2 1/6] dts: Remove build target config and list of devices

2024-09-12 Thread Nicholas Pratte
On Tue, Sep 10, 2024 at 7:30 AM Juraj Linkeš wrote: > > The subject line should be all lowercase (except for abbreviations and > maybe some other exceptions). Ack. > > On 5. 7. 2024 19:13, Nicholas Pratte wrote: > > Remove the list of devices from the schema, as these

  1   2   3   >