Add NAT64 to enable IPv6 provision in v4 only host #1567
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -10,6 +10,7 @@ CAPI_CONFIG_DIR: "{{ lookup('env', 'CAPI_CONFIG_DIR') | default('$HOME/.config/c | |
| CLUSTER_APIENDPOINT_HOST: "{{ lookup('env', 'CLUSTER_APIENDPOINT_HOST') }}" | ||
| CLUSTER_APIENDPOINT_PORT: "{{ lookup('env', 'CLUSTER_APIENDPOINT_PORT') | default(6443, true) }}" | ||
| CLUSTER_APIENDPOINT_IP: "{{ lookup('env', 'CLUSTER_APIENDPOINT_IP') }}" | ||
| CLUSTER_APIENDPOINT_LINK_LOCAL: "{{ ansible_facts['ironicendpoint']['ipv6'][2]['address'] }}" | ||
| CLUSTER_NAME: "{{ lookup('env', 'CLUSTER_NAME') | default('test1', true) }}" | ||
| CONTROL_PLANE_MACHINE_COUNT: "{{ lookup('env', 'CONTROL_PLANE_MACHINE_COUNT') | default(1, true) }}" | ||
| WORKER_MACHINE_COUNT: "{{ lookup('env', 'WORKER_MACHINE_COUNT') | default(1, true) }}" | ||
|
|
@@ -48,7 +49,7 @@ DEPLOY_RAMDISK_URL: "{{ lookup('env', 'DEPLOY_RAMDISK_URL') }}" | |
| IRONIC_URL: "{{ lookup('env', 'IRONIC_URL') }}" | ||
| IRONIC_INSPECTOR_URL: "{{ lookup('env', 'IRONIC_INSPECTOR_URL') }}" | ||
| POD_CIDR: "{{ lookup('env', 'POD_CIDR') }}" | ||
| SERVICE_CIDR: "{{ lookup('env', 'SERVICE_CIDR') | default('10.96.0.0/12', true) }}" | ||
| CAPM3RELEASE: "{{ lookup('env', 'CAPM3RELEASE') | default('v1.1.2', true) }}" | ||
| CAPIRELEASE: "{{ lookup('env', 'CAPIRELEASE') | default('v1.1.4', true) }}" | ||
| IPAMRELEASE: "{{ lookup('env', 'IPAMRELEASE') | default('v1.1.2', true) }}" | ||
|
|
@@ -61,6 +62,7 @@ CALICO_MINOR_RELEASE: "{{ lookup('env', 'CALICO_MINOR_RELEASE') | default('v3.25 | |
| CALICO_PATCH_RELEASE: "{{ lookup('env', 'CALICO_PATCH_RELEASE') | default('v3.25.1', true) }}" | ||
| DOCKER_HUB_PROXY: "{{ lookup('env', 'DOCKER_HUB_PROXY') }}" | ||
| WORKING_DIR: "{{ lookup('env', 'WORKING_DIR') | default('/opt/metal3-dev-env', true) }}" | ||
| LOCAL_DNS_V6: "{{ lookup('env', 'LOCAL_DNS_V6') | default('fd00:abcd::1', true) }}" | ||
|
There was a problem hiding this comment. Traditionally fd ULA-addresses have a 40-bit of Global ID: https://en.wikipedia.org/wiki/Unique_local_address ... yes, it can be zeros, but would still pick something else .... not that it really matters in this case. |
||
|
|
||
|
There was a problem hiding this comment. How about keeping the original default value: '2001:4860:4860::8888' or is that some obsolete value? |
||
| # Environment variables for deployment. IMAGE_OS can be centos or ubuntu, change accordingly to your needs. | ||
| IMAGE_OS: "{{ lookup('env', 'IMAGE_OS') | default('centos', true) }}" | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| nat64_action: setup | ||
| ENABLE_NAT64: "{{ lookup('env', 'ENABLE_NAT64') | default('false', true) }}" | ||
| TEMPLATES_PATH: "{{ metal3_dir }}/vm-setup/roles/nat64/files" | ||
| DNS_UPSTREAM: "{{ lookup('env', 'DNS_UPSTREAM') | default('10.1.0.2', true) }}" | ||
| DNS64_PREFIX: "{{ lookup('env', 'DNS64_PREFIX') | default('fd00:ffff:ffff::/96', true) }}" | ||
| # Local DNS is only used in IPv6 only env | ||
| LOCAL_DNS_V4: "{{ lookup('env', 'LOCAL_DNS_V4') | default('127.0.0.2', true) }}" | ||
| LOCAL_DNS_V6: "{{ lookup('env', 'LOCAL_DNS_V6') | default('fd00:abcd::1', true) }}" | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| - name: Install IPv6 only required packages | ||
| package: | ||
| name: | ||
| - tayga | ||
| - bind9 | ||
| state: present | ||
| when: nat64_action == "setup" | ||
|
|
||
| - name: Setup NAT64 | ||
| block: | ||
| - include_tasks: setup_nat.yml | ||
| when: nat64_action == "setup" | ||
|
|
||
| - name: Teardown NAT64 | ||
| block: | ||
| - include_tasks: teardown_nat.yml | ||
| when: nat64_action == "teardown" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,76 @@ | ||
| # Libvirt needs dnsmasq to manage networks. Installing it will likely automatically | ||
| # enable global dnsmasq. We don't want it. | ||
| - name: Ensure dnsmasq is stopped | ||
| ansible.builtin.systemd_service: | ||
| state: stopped | ||
| name: dnsmasq | ||
| become: yes | ||
|
|
||
| - name: Write Tayga configuration | ||
| template: | ||
| src: "../templates/tayga.conf" | ||
| dest: "/etc/tayga.conf" | ||
|
|
||
| - name: ensure IP forwarding is on | ||
| shell: | | ||
| sysctl net.ipv4.ip_forward=1 | ||
| sysctl net.ipv6.conf.all.forwarding=1 | ||
| become: yes | ||
|
|
||
| - name: Start NAT64 service tayga | ||
| ansible.builtin.systemd_service: | ||
| state: started | ||
| name: tayga | ||
| become: yes | ||
|
|
||
| - name: Generate Bind9 options file | ||
| template: | ||
| src: "../templates/named.conf.options" | ||
| dest: /etc/bind/named.conf.options | ||
| owner: root | ||
| group: root | ||
| mode: '0644' | ||
|
|
||
| # IPv6 only supported on ubuntu, so assume that systemd-resolved is | ||
| # the default dns resolution | ||
| - name: Disable systemd-resolved | ||
| ansible.builtin.systemd_service: | ||
| state: stopped | ||
| name: systemd-resolved | ||
| become: yes | ||
|
|
||
| - name: Write /etc/resolv.conf to contain local DNS server | ||
| template: | ||
| src: "../templates/resolv.conf" | ||
| dest: /etc/resolv.conf | ||
| owner: root | ||
| group: root | ||
| mode: '0644' | ||
| backup: true | ||
|
|
||
| # Note that if the address is regular 127.0.0.1, then this will add a duplicate | ||
| # address to the interface but with different subnet mask, the default | ||
| # subnetmask is 8 for IPv4 and | ||
| - name: Add DNS-server IPv4-address to loopback interface | ||
| shell: | ||
| cmd: "ip addr add {{ LOCAL_DNS_V4 }}/32 dev lo" | ||
| become: yes | ||
| ignore_errors: true | ||
|
|
||
| - name: Add DNS-server IPv6-address to loopback interface | ||
| shell: | ||
| cmd: "ip addr add {{ LOCAL_DNS_V6 }}/128 dev lo" | ||
| become: yes | ||
| ignore_errors: true | ||
|
|
||
| - name: Restart Bind9 service | ||
| ansible.builtin.systemd_service: | ||
| state: restarted | ||
| daemon_reload: true | ||
| name: named.service | ||
| become: yes | ||
|
|
||
| - name: Add local hostname to /etc/hosts | ||
| ansible.builtin.lineinfile: | ||
| path: /etc/hosts | ||
| line: 127.0.0.1 {{ ansible_hostname }} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| - name: Stop NAT64 service tayga | ||
| ansible.builtin.systemd_service: | ||
| state: stopped | ||
| name: tayga | ||
| become: yes | ||
|
|
||
| - name: Clean NAT64 interface | ||
| shell: | | ||
| ip link del nat64 | ||
| become: yes | ||
| ignore_errors: true | ||
|
|
||
| - name: Delete DNS-server IPv4-address from loopback interface | ||
| shell: | ||
| cmd: "ip addr del {{ LOCAL_DNS_V4 }}/32 dev lo" | ||
| become: yes | ||
| ignore_errors: true | ||
|
|
||
| - name: Delete DNS-server IPv6-address from loopback interface | ||
| shell: | ||
| cmd: "ip addr del {{ LOCAL_DNS_V6 }}/128 dev lo" | ||
| become: yes | ||
| ignore_errors: true | ||
|
There was a problem hiding this comment. We could also add IPv4 and IPv6 addresses to the tunnel device in order to enable sending of ICMP(v6) messages. It is a stupid that the need to be added manually, because they also need to be specified in the tayga configuration file. Well, life is. |
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| options { | ||
| directory "/var/cache/bind"; | ||
|
|
||
| forwarders { | ||
| {{ DNS_UPSTREAM }}; | ||
| }; | ||
|
|
||
| dnssec-validation auto; | ||
| listen-on { {{ LOCAL_DNS_V4 }}; }; | ||
| listen-on-v6 { {{ LOCAL_DNS_V6 }}; }; | ||
| dns64 {{ DNS64_PREFIX }} { | ||
| // Accept all requests | ||
| clients { any; }; | ||
| // maps all ipv4 addresses | ||
| mapped { any; }; | ||
| // excludes all native ipv6 addresses: even if domain has | ||
| // native ipv6 address bind will return mapped ipv4 address | ||
| exclude { any; }; | ||
| }; | ||
| }; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,2 @@ | ||
| nameserver {{ LOCAL_DNS_V4 }} | ||
| nameserver {{ LOCAL_DNS_V6 }} |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is there an original setup where we would prefer using CLUSTER_APIENDPOINT_HOST?