Hello,

On Thu, 2 Jul 2015, Alex Gartrell wrote:

> On Thu, Jul 2, 2015 at 2:18 PM, Alex Gartrell <alexgartr...@gmail.com> wrote:
> > If early demux was enabled, we'd use the route from the socket
> 
> Actually now that I think about it, this is probably broken, because
> we don't reply to the packet but instead silently drop it.

        I think, the problem is that input packet takes
the output path, not a problem with its sk_state.

        Here is how I understand the situation:

Input packet:

ip_rcv_finish:
        - early_demux:
                - attach skb->sk, skb->destructor, skb->dst
                - skb size is accounted later to sk

LOCAL_IN:
        - IPVS Remote Client mode: ip_vs_in
        - Case 1: IPVS forward to local real server (NF_ACCEPT case):
                - we are going to hit local server, so we should keep
                skb->sk, etc
                - skb->dst not changed
                - return NF_ACCEPT
                - continue to TCP stack
        - Case 2: IPVS forward TUN for example:
                - skb_orphan
                - we should not work with any skb->sk from input path
                - attach new skb->dst for the new real server
                - ip_local_out

TCP:
        - if IPVS does not grab the packet above, we have
        a call to skb_set_owner_r to account the skb size to sk


Locally generated TCP packet:

TCP tcp_transmit_skb:
        - attach skb->sk, skb->destructor, increase sk_wmem_alloc

LOCAL_OUT:
        - IPVS Local Client mode: again ip_vs_in
        - skb->dev is NULL means locally generated packet, skb->sk can
        be set by TCP
        - Case 1: IPVS forward to local real server (NF_ACCEPT case):
                - we are going to hit local server, so we should keep
                skb->sk, etc
                - skb->dst not changed
                - return NF_ACCEPT
                - continue to TCP stack in LOCAL_IN
        - Case 2: IPVS forward TUN for example:
                - no skb_orphan because skb->sk is for
                output path on skb->dev == NULL
                - realloc headroom (call skb_set_owner_w): should happen
                only for skb->sk from output path. This code in
                ip_vs_prepare_tunneled_skb comes from old days from
                ipip.c where skb->sk is present for locally generated
                packets and IPIP's xmit routine reallocs headroom
                - attach new skb->dst for the new real server
                - ip_local_out

To summarize:
        - we should call skb_orphan as soon as possible after
        deciding if packets goes to local or remote real server
        but only for skb->sk set by early_demux, not for packets
        sent by TCP
        - if packets go to local server IPVS should not touch
        skb->dst, skb->sk, etc (NF_ACCEPT case)
        - for skb->sk set by early_demux, skb_orphan should happen before
        skb_set_owner_w in ip_vs_prepare_tunneled_skb because
        skb_set_owner_w will try to increase sk_wmem_alloc which is
        wrong for early_demux phase
        - reaching skb_set_owner_w code for skb->sk set by eraly_demux
        looks wrong to me, it can happen on:
                - redirect (DNAT), if somehow we have socket too
                - IPVS redirect: if we forward both to local and remote
                real servers
                - not likely for forward, nobody forwards traffic
                destined to local IP to remote host

Regards

--
Julian Anastasov <j...@ssi.bg>
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Reply via email to